2026-03-28 18:30:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 18:30:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 18:30:06 [auto1.de] INFO: Batch mode enabled: batch 1/2
2026-03-28 18:30:06 [auto1.de] INFO: Starting spider auto1.de
2026-03-28 18:30:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 18:30:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 18:30:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 18:30:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 18:30:06 [scrapy.extensions.telnet] INFO: Telnet Password: 00316c4e2725b4bf
2026-03-28 18:30:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 18:30:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_17_2026-03-28T18_30_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 18:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 18:30:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 18:30:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 18:30:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 18:30:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 18:30:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-28 18:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 18:30:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-28 18:30:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 18:30:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 18:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 18:30:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 18:30:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 18:30:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 18:30:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 18:30:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 18:30:07 [scrapy.core.engine] INFO: Spider opened
2026-03-28 18:30:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 18:30:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 18:30:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 18:30:07 [scrapy-playwright] INFO: Starting download handler
2026-03-28 18:30:07 [scrapy-playwright] INFO: Starting download handler
2026-03-28 18:30:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 18:30:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 18:30:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 18:30:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 18:30:17 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 5991 | hits on page: 40
2026-03-28 18:30:17 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-28 18:30:17 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-28 18:30:17 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-28 18:30:17 [auto1.de] INFO: Scrape type for CK62820: 2
2026-03-28 18:30:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with identifier: CK62820
2026-03-28 18:30:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with scrape type 2
2026-03-28 18:30:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with scrape type 2
2026-03-28 18:30:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937, identifier: CK62820
2026-03-28 18:30:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with identifier: CK62820
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 18:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 18:30:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with identifier: CK62820
2026-03-28 18:30:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937 with identifier: CK62820 to the API
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'diesel',
 'id': '38b53e5d-aab1-5a03-bbdd-9b6d9a1b7937',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK62820',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 155373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'BMW 3er 325d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-28 18:30:17 [auto1.de] INFO: Saving data for CK62820: {'auction_closing_time': 1774884330.0, 'created_time': 1774034599.90676, 'last_price_update_time': 1774722617.998659}
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK62820') HTTP/1.1" 204 0
2026-03-28 18:30:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:18 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-28 18:30:18 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-28 18:30:18 [auto1.de] INFO: Scrape type for FC82221: 2
2026-03-28 18:30:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with identifier: FC82221
2026-03-28 18:30:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with scrape type 2
2026-03-28 18:30:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with scrape type 2
2026-03-28 18:30:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2, identifier: FC82221
2026-03-28 18:30:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with identifier: FC82221
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 18:30:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 18:30:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with identifier: FC82221
2026-03-28 18:30:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2c41a5b-3285-52cd-9af9-1ce73cdfbca2 with identifier: FC82221 to the API
2026-03-28 18:30:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:19:30Z',
 'fuel_type': 'petrol',
 'id': 'b2c41a5b-3285-52cd-9af9-1ce73cdfbca2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC82221',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 173281,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-09',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2014}
2026-03-28 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-28 18:30:19 [auto1.de] INFO: Saving data for FC82221: {'auction_closing_time': 1774883970.0, 'created_time': 1773466677.855246, 'last_price_update_time': 1774722619.944844}
2026-03-28 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC82221') HTTP/1.1" 204 0
2026-03-28 18:30:19 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-28 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-28 18:30:19 [auto1.de] INFO: Scrape type for MF60875: 1
2026-03-28 18:30:19 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-28 18:30:20 [auto1.de] INFO: Scrape type for KT60854: 2
2026-03-28 18:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2873f922-00c4-5252-842c-7e37e250fc25 with identifier: KT60854
2026-03-28 18:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2873f922-00c4-5252-842c-7e37e250fc25 with scrape type 2
2026-03-28 18:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2873f922-00c4-5252-842c-7e37e250fc25 with scrape type 2
2026-03-28 18:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2873f922-00c4-5252-842c-7e37e250fc25, identifier: KT60854
2026-03-28 18:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2873f922-00c4-5252-842c-7e37e250fc25 with identifier: KT60854
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 18:30:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2873f922-00c4-5252-842c-7e37e250fc25 with identifier: KT60854
2026-03-28 18:30:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2873f922-00c4-5252-842c-7e37e250fc25 with identifier: KT60854 to the API
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:47:05Z',
 'fuel_type': 'diesel',
 'id': '2873f922-00c4-5252-842c-7e37e250fc25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT60854',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 160265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-05',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Premium L2',
 'transmission': 'manual',
 'trim': 'Premium L2',
 'year': 2018}
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-28 18:30:20 [auto1.de] INFO: Saving data for KT60854: {'auction_closing_time': 1774885625.0, 'created_time': 1774033622.967975, 'last_price_update_time': 1774722620.757985}
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT60854') HTTP/1.1" 204 0
2026-03-28 18:30:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:20 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-28 18:30:20 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-28 18:30:20 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-28 18:30:20 [auto1.de] INFO: Scrape type for MG42603: 2
2026-03-28 18:30:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 285887e2-7c17-56ac-88d2-8509212658e2 with identifier: MG42603
2026-03-28 18:30:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 285887e2-7c17-56ac-88d2-8509212658e2 with scrape type 2
2026-03-28 18:30:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 285887e2-7c17-56ac-88d2-8509212658e2 with scrape type 2
2026-03-28 18:30:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 285887e2-7c17-56ac-88d2-8509212658e2, identifier: MG42603
2026-03-28 18:30:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 285887e2-7c17-56ac-88d2-8509212658e2 with identifier: MG42603
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 18:30:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 285887e2-7c17-56ac-88d2-8509212658e2 with identifier: MG42603
2026-03-28 18:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 285887e2-7c17-56ac-88d2-8509212658e2 with identifier: MG42603 to the API
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:14:12Z',
 'fuel_type': 'petrol',
 'id': '285887e2-7c17-56ac-88d2-8509212658e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG42603',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 181300,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2015}
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-28 18:30:21 [auto1.de] INFO: Saving data for MG42603: {'auction_closing_time': 1774883652.0, 'created_time': 1774349157.257162, 'last_price_update_time': 1774722621.507969}
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG42603') HTTP/1.1" 204 0
2026-03-28 18:30:21 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-28 18:30:21 [auto1.de] INFO: Scrape type for FK12887: 2
2026-03-28 18:30:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with identifier: FK12887
2026-03-28 18:30:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with scrape type 2
2026-03-28 18:30:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with scrape type 2
2026-03-28 18:30:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d, identifier: FK12887
2026-03-28 18:30:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with identifier: FK12887
2026-03-28 18:30:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with identifier: FK12887
2026-03-28 18:30:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d9e3855-0e5e-5a2b-8d46-19f99fcad03d with identifier: FK12887 to the API
2026-03-28 18:30:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:02:58Z',
 'fuel_type': 'petrol',
 'id': '8d9e3855-0e5e-5a2b-8d46-19f99fcad03d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK12887',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 124733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-27',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2011}
2026-03-28 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-28 18:30:22 [auto1.de] INFO: Saving data for FK12887: {'auction_closing_time': 1774882978.0, 'created_time': 1774349748.698466, 'last_price_update_time': 1774722622.827509}
2026-03-28 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK12887') HTTP/1.1" 204 0
2026-03-28 18:30:22 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-28 18:30:22 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-28 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-28 18:30:22 [auto1.de] INFO: Scrape type for CH93645: 2
2026-03-28 18:30:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with identifier: CH93645
2026-03-28 18:30:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with scrape type 2
2026-03-28 18:30:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with scrape type 2
2026-03-28 18:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef8e5418-5f64-5de6-ae46-14b3442ad5d8, identifier: CH93645
2026-03-28 18:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with identifier: CH93645
2026-03-28 18:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with identifier: CH93645
2026-03-28 18:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef8e5418-5f64-5de6-ae46-14b3442ad5d8 with identifier: CH93645 to the API
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:26:58Z',
 'fuel_type': 'petrol',
 'id': 'ef8e5418-5f64-5de6-ae46-14b3442ad5d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH93645',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 114214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-20',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-28 18:30:23 [auto1.de] INFO: Saving data for CH93645: {'auction_closing_time': 1774884418.0, 'created_time': 1773468583.218764, 'last_price_update_time': 1774722623.464298}
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH93645') HTTP/1.1" 204 0
2026-03-28 18:30:23 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 18:30:23 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-28 18:30:23 [auto1.de] INFO: Scrape type for JP33538: 2
2026-03-28 18:30:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with identifier: JP33538
2026-03-28 18:30:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with scrape type 2
2026-03-28 18:30:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with scrape type 2
2026-03-28 18:30:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d, identifier: JP33538
2026-03-28 18:30:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with identifier: JP33538
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 18:30:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with identifier: JP33538
2026-03-28 18:30:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c30d998f-02ab-5ba8-866e-d29ca3cc3e9d with identifier: JP33538 to the API
2026-03-28 18:30:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:34Z',
 'fuel_type': 'diesel',
 'id': 'c30d998f-02ab-5ba8-866e-d29ca3cc3e9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP33538',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 52352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-17',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-28 18:30:24 [auto1.de] INFO: Saving data for JP33538: {'auction_closing_time': 1774883974.0, 'created_time': 1774034102.377192, 'last_price_update_time': 1774722624.117745}
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP33538') HTTP/1.1" 204 0
2026-03-28 18:30:24 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-28 18:30:24 [auto1.de] INFO: Scrape type for YT05280: 2
2026-03-28 18:30:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 041be986-6b99-50e8-b776-fc09ed64a53a with identifier: YT05280
2026-03-28 18:30:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 041be986-6b99-50e8-b776-fc09ed64a53a with scrape type 2
2026-03-28 18:30:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 041be986-6b99-50e8-b776-fc09ed64a53a with scrape type 2
2026-03-28 18:30:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 041be986-6b99-50e8-b776-fc09ed64a53a, identifier: YT05280
2026-03-28 18:30:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 041be986-6b99-50e8-b776-fc09ed64a53a with identifier: YT05280
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-28 18:30:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 041be986-6b99-50e8-b776-fc09ed64a53a with identifier: YT05280
2026-03-28 18:30:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 041be986-6b99-50e8-b776-fc09ed64a53a with identifier: YT05280 to the API
2026-03-28 18:30:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:56:03Z',
 'fuel_type': 'petrol',
 'id': '041be986-6b99-50e8-b776-fc09ed64a53a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT05280',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 165298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-28 18:30:25 [auto1.de] INFO: Saving data for YT05280: {'auction_closing_time': 1774886163.0, 'created_time': 1774118395.910183, 'last_price_update_time': 1774722625.689473}
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT05280') HTTP/1.1" 204 0
2026-03-28 18:30:25 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-28 18:30:25 [auto1.de] INFO: Scrape type for RF07068: 1
2026-03-28 18:30:25 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 5992 | hits on page: 40
2026-03-28 18:30:25 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-28 18:30:25 [auto1.de] INFO: Scrape type for MU49508: 2
2026-03-28 18:30:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57408875-a72b-51ea-be38-bba26194e66b with identifier: MU49508
2026-03-28 18:30:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57408875-a72b-51ea-be38-bba26194e66b with scrape type 2
2026-03-28 18:30:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57408875-a72b-51ea-be38-bba26194e66b with scrape type 2
2026-03-28 18:30:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57408875-a72b-51ea-be38-bba26194e66b, identifier: MU49508
2026-03-28 18:30:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MF60875/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57408875-a72b-51ea-be38-bba26194e66b with identifier: MU49508
2026-03-28 18:30:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57408875-a72b-51ea-be38-bba26194e66b with identifier: MU49508
2026-03-28 18:30:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57408875-a72b-51ea-be38-bba26194e66b with identifier: MU49508 to the API
2026-03-28 18:30:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:38:37Z',
 'fuel_type': 'diesel',
 'id': '57408875-a72b-51ea-be38-bba26194e66b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU49508',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 337044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2012}
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Saving data for MU49508: {'auction_closing_time': 1774885117.0, 'created_time': 1774349537.52918, 'last_price_update_time': 1774722626.289926}
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU49508') HTTP/1.1" 204 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62820%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for CK62820: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC82221%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for FC82221: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-28 18:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for KD86114: 1
2026-03-28 18:30:26 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/MF60875/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60854%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for KT60854: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG42603%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for MG42603: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK12887%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for FK12887: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH93645%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for CH93645: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP33538%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for JP33538: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05280%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for YT05280: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for EF75873: 1
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU49508%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for MU49508: 0
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-28 18:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for HZ55109: 1
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-28 18:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:26 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-28 18:30:26 [auto1.de] INFO: Scrape type for UR98067: 2
2026-03-28 18:30:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23df2a60-cac0-5843-92ed-4b677d992563 with identifier: UR98067
2026-03-28 18:30:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23df2a60-cac0-5843-92ed-4b677d992563 with scrape type 2
2026-03-28 18:30:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23df2a60-cac0-5843-92ed-4b677d992563 with scrape type 2
2026-03-28 18:30:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23df2a60-cac0-5843-92ed-4b677d992563, identifier: UR98067
2026-03-28 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23df2a60-cac0-5843-92ed-4b677d992563 with identifier: UR98067
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 18:30:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23df2a60-cac0-5843-92ed-4b677d992563 with identifier: UR98067
2026-03-28 18:30:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23df2a60-cac0-5843-92ed-4b677d992563 with identifier: UR98067 to the API
2026-03-28 18:30:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:59:53Z',
 'fuel_type': 'petrol',
 'id': '23df2a60-cac0-5843-92ed-4b677d992563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR98067',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 160623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-27',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2012}
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-28 18:30:27 [auto1.de] INFO: Saving data for UR98067: {'auction_closing_time': 1774886393.0, 'created_time': 1773467737.384401, 'last_price_update_time': 1774722627.303478}
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR98067') HTTP/1.1" 204 0
2026-03-28 18:30:27 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-28 18:30:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:27 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-28 18:30:27 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-28 18:30:27 [auto1.de] INFO: Scrape type for CX74060: 2
2026-03-28 18:30:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b03f0dbc-0a74-51f7-80d7-f054559dfe61 with identifier: CX74060
2026-03-28 18:30:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b03f0dbc-0a74-51f7-80d7-f054559dfe61 with scrape type 2
2026-03-28 18:30:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b03f0dbc-0a74-51f7-80d7-f054559dfe61 with scrape type 2
2026-03-28 18:30:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b03f0dbc-0a74-51f7-80d7-f054559dfe61, identifier: CX74060
2026-03-28 18:30:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b03f0dbc-0a74-51f7-80d7-f054559dfe61 with identifier: CX74060
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 18:30:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b03f0dbc-0a74-51f7-80d7-f054559dfe61 with identifier: CX74060
2026-03-28 18:30:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b03f0dbc-0a74-51f7-80d7-f054559dfe61 with identifier: CX74060 to the API
2026-03-28 18:30:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:21Z',
 'fuel_type': 'diesel',
 'id': 'b03f0dbc-0a74-51f7-80d7-f054559dfe61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX74060',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 164533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-28',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline 4Motion',
 'transmission': 'manual',
 'trim': 'Trendline 4Motion',
 'year': 2013}
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-28 18:30:28 [auto1.de] INFO: Saving data for CX74060: {'auction_closing_time': 1774884981.0, 'created_time': 1773426704.978276, 'last_price_update_time': 1774722628.543593}
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX74060') HTTP/1.1" 204 0
2026-03-28 18:30:28 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98067%27 HTTP/1.1" 200 None
2026-03-28 18:30:28 [auto1.de] INFO: Scrape type for UR98067: 0
2026-03-28 18:30:28 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-28 18:30:28 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX74060%27 HTTP/1.1" 200 None
2026-03-28 18:30:28 [auto1.de] INFO: Scrape type for CX74060: 0
2026-03-28 18:30:28 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-28 18:30:28 [auto1.de] INFO: Scrape type for LA18154: 2
2026-03-28 18:30:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154
2026-03-28 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b923b9-bba2-5b47-91e0-df2a861efbf4 with scrape type 2
2026-03-28 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b923b9-bba2-5b47-91e0-df2a861efbf4 with scrape type 2
2026-03-28 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4b923b9-bba2-5b47-91e0-df2a861efbf4, identifier: LA18154
2026-03-28 18:30:28 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-28 18:30:28 [auto1.de] INFO: Scrape type for LA18154: 2
2026-03-28 18:30:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4b923b9-bba2-5b47-91e0-df2a861efbf4 with scrape type 2
2026-03-28 18:30:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4b923b9-bba2-5b47-91e0-df2a861efbf4 with scrape type 2
2026-03-28 18:30:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4b923b9-bba2-5b47-91e0-df2a861efbf4, identifier: LA18154
2026-03-28 18:30:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154
2026-03-28 18:30:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154
2026-03-28 18:30:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154 to the API
2026-03-28 18:30:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:53:19Z',
 'fuel_type': 'petrol',
 'id': 'f4b923b9-bba2-5b47-91e0-df2a861efbf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA18154',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 103332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Trend 2WD',
 'transmission': 'manual',
 'trim': 'Trend 2WD',
 'year': 2019}
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-28 18:30:29 [auto1.de] INFO: Saving data for LA18154: {'auction_closing_time': 1774885999.0, 'created_time': 1773467571.930998, 'last_price_update_time': 1774722629.199069}
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA18154') HTTP/1.1" 204 0
2026-03-28 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154
2026-03-28 18:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154
2026-03-28 18:30:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4b923b9-bba2-5b47-91e0-df2a861efbf4 with identifier: LA18154 to the API
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:53:19Z',
 'fuel_type': 'petrol',
 'id': 'f4b923b9-bba2-5b47-91e0-df2a861efbf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA18154',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 103332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-12',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Trend 2WD',
 'transmission': 'manual',
 'trim': 'Trend 2WD',
 'year': 2019}
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA18154%27 HTTP/1.1" 200 None
2026-03-28 18:30:29 [auto1.de] INFO: Saving data for LA18154: {'auction_closing_time': 1774885999.0, 'created_time': 1773467571.930998, 'last_price_update_time': 1774722629.493402}
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA18154') HTTP/1.1" 204 0
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-28 18:30:29 [auto1.de] INFO: Scrape type for CW95568: 2
2026-03-28 18:30:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568
2026-03-28 18:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ae5883-2dca-50f6-a67f-dc87cfd92846 with scrape type 2
2026-03-28 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74ae5883-2dca-50f6-a67f-dc87cfd92846 with scrape type 2
2026-03-28 18:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74ae5883-2dca-50f6-a67f-dc87cfd92846, identifier: CW95568
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-28 18:30:29 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-28 18:30:29 [auto1.de] INFO: Scrape type for CW95568: 2
2026-03-28 18:30:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74ae5883-2dca-50f6-a67f-dc87cfd92846 with scrape type 2
2026-03-28 18:30:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74ae5883-2dca-50f6-a67f-dc87cfd92846 with scrape type 2
2026-03-28 18:30:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74ae5883-2dca-50f6-a67f-dc87cfd92846, identifier: CW95568
2026-03-28 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 18:30:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568
2026-03-28 18:30:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568 to the API
2026-03-28 18:30:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:14:44Z',
 'fuel_type': 'petrol',
 'id': '74ae5883-2dca-50f6-a67f-dc87cfd92846',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW95568',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 116382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-28 18:30:31 [auto1.de] INFO: Saving data for CW95568: {'auction_closing_time': 1774883684.0, 'created_time': 1773468995.412244, 'last_price_update_time': 1774722631.427754}
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW95568') HTTP/1.1" 204 0
2026-03-28 18:30:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568
2026-03-28 18:30:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568
2026-03-28 18:30:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74ae5883-2dca-50f6-a67f-dc87cfd92846 with identifier: CW95568 to the API
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:14:44Z',
 'fuel_type': 'petrol',
 'id': '74ae5883-2dca-50f6-a67f-dc87cfd92846',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW95568',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 116382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.2 PureTech Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2018}
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW95568%27 HTTP/1.1" 200 None
2026-03-28 18:30:31 [auto1.de] INFO: Saving data for CW95568: {'auction_closing_time': 1774883684.0, 'created_time': 1773468995.412244, 'last_price_update_time': 1774722631.875653}
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW95568') HTTP/1.1" 204 0
2026-03-28 18:30:31 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-28 18:30:31 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-28 18:30:31 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-28 18:30:31 [auto1.de] INFO: Scrape type for GD26044: 2
2026-03-28 18:30:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044
2026-03-28 18:30:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6a9cdc8-2d56-596c-9881-85c8182855cd with scrape type 2
2026-03-28 18:30:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6a9cdc8-2d56-596c-9881-85c8182855cd with scrape type 2
2026-03-28 18:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6a9cdc8-2d56-596c-9881-85c8182855cd, identifier: GD26044
2026-03-28 18:30:32 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-28 18:30:32 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-28 18:30:32 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-28 18:30:32 [auto1.de] INFO: Scrape type for GD26044: 2
2026-03-28 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6a9cdc8-2d56-596c-9881-85c8182855cd with scrape type 2
2026-03-28 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6a9cdc8-2d56-596c-9881-85c8182855cd with scrape type 2
2026-03-28 18:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6a9cdc8-2d56-596c-9881-85c8182855cd, identifier: GD26044
2026-03-28 18:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044
2026-03-28 18:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044
2026-03-28 18:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044 to the API
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:31:13Z',
 'fuel_type': 'diesel',
 'id': 'f6a9cdc8-2d56-596c-9881-85c8182855cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD26044',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 124870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-23',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-28 18:30:32 [auto1.de] INFO: Saving data for GD26044: {'auction_closing_time': 1774884673.0, 'created_time': 1773302229.467592, 'last_price_update_time': 1774722632.487393}
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD26044') HTTP/1.1" 204 0
2026-03-28 18:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044
2026-03-28 18:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044
2026-03-28 18:30:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6a9cdc8-2d56-596c-9881-85c8182855cd with identifier: GD26044 to the API
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:31:13Z',
 'fuel_type': 'diesel',
 'id': 'f6a9cdc8-2d56-596c-9881-85c8182855cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD26044',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 124870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-23',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD26044%27 HTTP/1.1" 200 None
2026-03-28 18:30:32 [auto1.de] INFO: Saving data for GD26044: {'auction_closing_time': 1774884673.0, 'created_time': 1773302229.467592, 'last_price_update_time': 1774722632.780098}
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD26044') HTTP/1.1" 204 0
2026-03-28 18:30:32 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-28 18:30:32 [auto1.de] INFO: Scrape type for EE96817: 2
2026-03-28 18:30:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4776b629-e013-5570-8f72-88347287f5f5 with identifier: EE96817
2026-03-28 18:30:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4776b629-e013-5570-8f72-88347287f5f5 with scrape type 2
2026-03-28 18:30:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4776b629-e013-5570-8f72-88347287f5f5 with scrape type 2
2026-03-28 18:30:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4776b629-e013-5570-8f72-88347287f5f5, identifier: EE96817
2026-03-28 18:30:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4776b629-e013-5570-8f72-88347287f5f5 with identifier: EE96817
2026-03-28 18:30:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4776b629-e013-5570-8f72-88347287f5f5 with identifier: EE96817
2026-03-28 18:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4776b629-e013-5570-8f72-88347287f5f5 with identifier: EE96817 to the API
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:25Z',
 'fuel_type': 'petrol',
 'id': '4776b629-e013-5570-8f72-88347287f5f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE96817',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 69055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-25',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [auto1.de] INFO: Saving data for EE96817: {'auction_closing_time': 1774885765.0, 'created_time': 1774089201.051592, 'last_price_update_time': 1774722633.255809}
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE96817') HTTP/1.1" 204 0
2026-03-28 18:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF75873/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD86114/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MF60875> (referer: https://www.auto1.com/v1/car-details-view/MF60875/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with identifier: MF60875
2026-03-28 18:30:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with scrape type 1
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 461fcb9f-a50e-551b-9dfb-a2c5046efed9
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_410fcded8b8a85187b209840893142e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_410fcded8b8a85187b209840893142e1.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_0a522a821fce38a985179dc8e92da6bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_0a522a821fce38a985179dc8e92da6bc.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_3c30ea0acdd94664887a9a36f3a95b72.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_3c30ea0acdd94664887a9a36f3a95b72.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_5a183041d842afd602b0e65a72dd702f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_5a183041d842afd602b0e65a72dd702f.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_40e2e8f4f1811c59f2781ba34b4d772a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_40e2e8f4f1811c59f2781ba34b4d772a.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_b5113565426368903a37f914e09064b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_b5113565426368903a37f914e09064b0.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_e5b3487dce92f5db92d3eba1b52dcfb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_e5b3487dce92f5db92d3eba1b52dcfb7.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_84dc571e2c8fb9ceec7bc3de9d0ad0cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_84dc571e2c8fb9ceec7bc3de9d0ad0cb.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_2440a217975785af6fc6e843a0468a51.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_2440a217975785af6fc6e843a0468a51.jpg already downloaded
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252F36%252Ff0362601817d98bea42a0599a57c767e%252Fpa%252FMF60875_aeb5aaf0fe48127bd32d463930962fb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_aeb5aaf0fe48127bd32d463930962fb3.jpg already downloaded
2026-03-28 18:30:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 461fcb9f-a50e-551b-9dfb-a2c5046efed9, identifier: MF60875
2026-03-28 18:30:33 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 5992 | hits on page: 40
2026-03-28 18:30:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with identifier: MF60875
2026-03-28 18:30:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with identifier: MF60875
2026-03-28 18:30:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 461fcb9f-a50e-551b-9dfb-a2c5046efed9 with identifier: MF60875 to the API
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MF60875>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:20:37Z',
 'fuel_type': 'diesel',
 'id': '461fcb9f-a50e-551b-9dfb-a2c5046efed9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF60875',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 261321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_410fcded8b8a85187b209840893142e1.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_0a522a821fce38a985179dc8e92da6bc.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_3c30ea0acdd94664887a9a36f3a95b72.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_5a183041d842afd602b0e65a72dd702f.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_40e2e8f4f1811c59f2781ba34b4d772a.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_b5113565426368903a37f914e09064b0.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_e5b3487dce92f5db92d3eba1b52dcfb7.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_84dc571e2c8fb9ceec7bc3de9d0ad0cb.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_2440a217975785af6fc6e843a0468a51.jpg',
                'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_aeb5aaf0fe48127bd32d463930962fb3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_410fcded8b8a85187b209840893142e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_0a522a821fce38a985179dc8e92da6bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_3c30ea0acdd94664887a9a36f3a95b72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_5a183041d842afd602b0e65a72dd702f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_40e2e8f4f1811c59f2781ba34b4d772a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_b5113565426368903a37f914e09064b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71676,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_e5b3487dce92f5db92d3eba1b52dcfb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_84dc571e2c8fb9ceec7bc3de9d0ad0cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_2440a217975785af6fc6e843a0468a51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_461fcb9f-a50e-551b-9dfb-a2c5046efed9/461fcb9f-a50e-551b-9dfb-a2c5046efed9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/36/f0362601817d98bea42a0599a57c767e/pa/MF60875_aeb5aaf0fe48127bd32d463930962fb3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 220 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF60875%27 HTTP/1.1" 200 None
2026-03-28 18:30:34 [auto1.de] INFO: Saving data for MF60875: {'created_time': 1774722634.019599, 'last_price_update_time': 1774722634.019611, 'auction_closing_time': 1774884037.0}
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF60875') HTTP/1.1" 204 0
2026-03-28 18:30:34 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE96817%27 HTTP/1.1" 200 None
2026-03-28 18:30:34 [auto1.de] INFO: Scrape type for EE96817: 0
2026-03-28 18:30:34 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-28 18:30:34 [auto1.de] INFO: Scrape type for NH06338: 1
2026-03-28 18:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ55109/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF07068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:34 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-28 18:30:34 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-28 18:30:34 [auto1.de] INFO: Scrape type for MF86039: 2
2026-03-28 18:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afcca04c-440f-5f6b-b12e-105c4a41bbba with identifier: MF86039
2026-03-28 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afcca04c-440f-5f6b-b12e-105c4a41bbba with scrape type 2
2026-03-28 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afcca04c-440f-5f6b-b12e-105c4a41bbba with scrape type 2
2026-03-28 18:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afcca04c-440f-5f6b-b12e-105c4a41bbba, identifier: MF86039
2026-03-28 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afcca04c-440f-5f6b-b12e-105c4a41bbba with identifier: MF86039
2026-03-28 18:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afcca04c-440f-5f6b-b12e-105c4a41bbba with identifier: MF86039
2026-03-28 18:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afcca04c-440f-5f6b-b12e-105c4a41bbba with identifier: MF86039 to the API
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:27Z',
 'fuel_type': 'diesel',
 'id': 'afcca04c-440f-5f6b-b12e-105c4a41bbba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF86039',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 279207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF86039%27 HTTP/1.1" 200 None
2026-03-28 18:30:34 [auto1.de] INFO: Saving data for MF86039: {'auction_closing_time': 1774883547.0, 'created_time': 1774350112.359188, 'last_price_update_time': 1774722634.558117}
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF86039') HTTP/1.1" 204 0
2026-03-28 18:30:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:34 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-28 18:30:34 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-28 18:30:34 [auto1.de] INFO: Scrape type for SJ64604: 2
2026-03-28 18:30:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4891959-2518-5cf4-b03a-eeb28e47269e with identifier: SJ64604
2026-03-28 18:30:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4891959-2518-5cf4-b03a-eeb28e47269e with scrape type 2
2026-03-28 18:30:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4891959-2518-5cf4-b03a-eeb28e47269e with scrape type 2
2026-03-28 18:30:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4891959-2518-5cf4-b03a-eeb28e47269e, identifier: SJ64604
2026-03-28 18:30:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4891959-2518-5cf4-b03a-eeb28e47269e with identifier: SJ64604
2026-03-28 18:30:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4891959-2518-5cf4-b03a-eeb28e47269e with identifier: SJ64604
2026-03-28 18:30:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4891959-2518-5cf4-b03a-eeb28e47269e with identifier: SJ64604 to the API
2026-03-28 18:30:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:36:41Z',
 'fuel_type': 'petrol',
 'id': 'e4891959-2518-5cf4-b03a-eeb28e47269e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ64604',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 219095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-10',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64604%27 HTTP/1.1" 200 None
2026-03-28 18:30:35 [auto1.de] INFO: Saving data for SJ64604: {'auction_closing_time': 1774885001.0, 'created_time': 1773427626.721407, 'last_price_update_time': 1774722635.1615}
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ64604') HTTP/1.1" 204 0
2026-03-28 18:30:35 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-28 18:30:35 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-28 18:30:35 [auto1.de] INFO: Scrape type for DT57257: 2
2026-03-28 18:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faa2166b-ac17-5280-9bbe-7a1a537270f8 with identifier: DT57257
2026-03-28 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faa2166b-ac17-5280-9bbe-7a1a537270f8 with scrape type 2
2026-03-28 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faa2166b-ac17-5280-9bbe-7a1a537270f8 with scrape type 2
2026-03-28 18:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faa2166b-ac17-5280-9bbe-7a1a537270f8, identifier: DT57257
2026-03-28 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faa2166b-ac17-5280-9bbe-7a1a537270f8 with identifier: DT57257
2026-03-28 18:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faa2166b-ac17-5280-9bbe-7a1a537270f8 with identifier: DT57257
2026-03-28 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faa2166b-ac17-5280-9bbe-7a1a537270f8 with identifier: DT57257 to the API
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:58:50Z',
 'fuel_type': 'diesel',
 'id': 'faa2166b-ac17-5280-9bbe-7a1a537270f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT57257',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 159942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-11',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT57257%27 HTTP/1.1" 200 None
2026-03-28 18:30:35 [auto1.de] INFO: Saving data for DT57257: {'auction_closing_time': 1774886330.0, 'created_time': 1773429154.259543, 'last_price_update_time': 1774722635.623587}
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT57257') HTTP/1.1" 204 0
2026-03-28 18:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:35 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-28 18:30:35 [auto1.de] INFO: Scrape type for VT63649: 2
2026-03-28 18:30:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8e47cae-82a9-5e87-9a19-15afe5a20e8f with identifier: VT63649
2026-03-28 18:30:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e47cae-82a9-5e87-9a19-15afe5a20e8f with scrape type 2
2026-03-28 18:30:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8e47cae-82a9-5e87-9a19-15afe5a20e8f with scrape type 2
2026-03-28 18:30:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8e47cae-82a9-5e87-9a19-15afe5a20e8f, identifier: VT63649
2026-03-28 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8e47cae-82a9-5e87-9a19-15afe5a20e8f with identifier: VT63649
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 18:30:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8e47cae-82a9-5e87-9a19-15afe5a20e8f with identifier: VT63649
2026-03-28 18:30:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8e47cae-82a9-5e87-9a19-15afe5a20e8f with identifier: VT63649 to the API
2026-03-28 18:30:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'petrol',
 'id': 'e8e47cae-82a9-5e87-9a19-15afe5a20e8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT63649',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 149592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT63649%27 HTTP/1.1" 200 None
2026-03-28 18:30:36 [auto1.de] INFO: Saving data for VT63649: {'auction_closing_time': 1774886039.0, 'created_time': 1773468735.32282, 'last_price_update_time': 1774722636.210525}
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT63649') HTTP/1.1" 204 0
2026-03-28 18:30:36 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-28 18:30:36 [auto1.de] INFO: Scrape type for JX79740: 2
2026-03-28 18:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with identifier: JX79740
2026-03-28 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with scrape type 2
2026-03-28 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with scrape type 2
2026-03-28 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b, identifier: JX79740
2026-03-28 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with identifier: JX79740
2026-03-28 18:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with identifier: JX79740
2026-03-28 18:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53ffc70a-1ed1-586a-934a-d1d7b1d4030b with identifier: JX79740 to the API
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:56:38Z',
 'fuel_type': 'diesel',
 'id': '53ffc70a-1ed1-586a-934a-d1d7b1d4030b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX79740',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 109003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-20',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX79740%27 HTTP/1.1" 200 None
2026-03-28 18:30:36 [auto1.de] INFO: Saving data for JX79740: {'auction_closing_time': 1774886198.0, 'created_time': 1774118866.14086, 'last_price_update_time': 1774722636.656625}
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX79740') HTTP/1.1" 204 0
2026-03-28 18:30:36 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-28 18:30:36 [auto1.de] INFO: Scrape type for FR69109: 2
2026-03-28 18:30:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with identifier: FR69109
2026-03-28 18:30:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with scrape type 2
2026-03-28 18:30:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with scrape type 2
2026-03-28 18:30:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43, identifier: FR69109
2026-03-28 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF75873> (referer: https://www.auto1.com/v1/car-details-view/EF75873/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD86114> (referer: https://www.auto1.com/v1/car-details-view/KD86114/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with identifier: FR69109
2026-03-28 18:30:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with identifier: FR69109
2026-03-28 18:30:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 164b0b97-5f2b-57e7-ad9f-b2cf28262f43 with identifier: FR69109 to the API
2026-03-28 18:30:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:04:48Z',
 'fuel_type': 'petrol',
 'id': '164b0b97-5f2b-57e7-ad9f-b2cf28262f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR69109',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 113159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Toyota Auris 1.3 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR69109%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [auto1.de] INFO: Saving data for FR69109: {'auction_closing_time': 1774883088.0, 'created_time': 1774031521.331701, 'last_price_update_time': 1774722637.114641}
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR69109') HTTP/1.1" 204 0
2026-03-28 18:30:37 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [auto1.de] INFO: Scrape type for BS19118: 2
2026-03-28 18:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with identifier: BS19118
2026-03-28 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with scrape type 2
2026-03-28 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with scrape type 2
2026-03-28 18:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70ee74f4-9aff-5d15-abb4-50dbac5fa953, identifier: BS19118
2026-03-28 18:30:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with identifier: BS19118
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 18:30:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:30:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with identifier: BS19118
2026-03-28 18:30:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70ee74f4-9aff-5d15-abb4-50dbac5fa953 with identifier: BS19118 to the API
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:00:49Z',
 'fuel_type': 'hybrid',
 'id': '70ee74f4-9aff-5d15-abb4-50dbac5fa953',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS19118',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 40199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seller_name': None,
 'title': 'Peugeot 508 1.6 Hybrid 225 GT',
 'transmission': 'automatic',
 'trim': '225 GT',
 'year': 2022}
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS19118%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [auto1.de] INFO: Saving data for BS19118: {'auction_closing_time': 1774882849.0, 'created_time': 1774034053.785726, 'last_price_update_time': 1774722637.700055}
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS19118') HTTP/1.1" 204 0
2026-03-28 18:30:37 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-28 18:30:37 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-28 18:30:37 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-28 18:30:37 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP11609%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [auto1.de] INFO: Scrape type for UP11609: 0
2026-03-28 18:30:37 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [auto1.de] INFO: Scrape type for SL92984: 1
2026-03-28 18:30:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:37 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [auto1.de] INFO: Scrape type for GH39731: 2
2026-03-28 18:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e93735e-2da9-50ca-bf5f-bfab5874df2d with identifier: GH39731
2026-03-28 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e93735e-2da9-50ca-bf5f-bfab5874df2d with scrape type 2
2026-03-28 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e93735e-2da9-50ca-bf5f-bfab5874df2d with scrape type 2
2026-03-28 18:30:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e93735e-2da9-50ca-bf5f-bfab5874df2d, identifier: GH39731
2026-03-28 18:30:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with identifier: EF75873
2026-03-28 18:30:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with scrape type 1
2026-03-28 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6eaacb14-3bca-5de9-9be6-a6bce274e6c6
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_ea96d5b28a76f1ba669a3417f13830c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_ea96d5b28a76f1ba669a3417f13830c6.jpg already downloaded
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_1f2f1bda1bcb7c73b6d3fbbeaf3fb700.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_1f2f1bda1bcb7c73b6d3fbbeaf3fb700.jpg already downloaded
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_0e57b4e1c54138ce1878383e76f3fdd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_0e57b4e1c54138ce1878383e76f3fdd0.jpg already downloaded
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_69d5a08621eda647505d6039d68f7451.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_69d5a08621eda647505d6039d68f7451.jpg already downloaded
2026-03-28 18:30:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_e3e5e5bf02af97493739221d9b163ab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_e3e5e5bf02af97493739221d9b163ab6.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_9b7e810127518cb40cae505b2bb9586f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_9b7e810127518cb40cae505b2bb9586f.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_8d7f1ff742f5fd44819df009bd52de02.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_8d7f1ff742f5fd44819df009bd52de02.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_5ffb31159a389e6ef496d4f1b74915d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_5ffb31159a389e6ef496d4f1b74915d5.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_6759b392f39dc098f1f920e3d7c11b2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_6759b392f39dc098f1f920e3d7c11b2e.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252F46%252Fca46f0f6d5242e3abc81991dcc589b66%252Fpa%252FEF75873_88f0ecbfdffbbedb0a57f740a43a6bbf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_88f0ecbfdffbbedb0a57f740a43a6bbf.jpg already downloaded
2026-03-28 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6, identifier: EF75873
2026-03-28 18:30:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e35f26-b653-5b62-adbd-a8768fa97370 with identifier: KD86114
2026-03-28 18:30:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e35f26-b653-5b62-adbd-a8768fa97370 with scrape type 1
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55e35f26-b653-5b62-adbd-a8768fa97370
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_d1afd96ead17a6ccfe020dd1160f2421.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_d1afd96ead17a6ccfe020dd1160f2421.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_a4709c3aafa4e2e09f45909d5d94b654.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_a4709c3aafa4e2e09f45909d5d94b654.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_28785c96e1a288d029bb1afef0fed323.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_28785c96e1a288d029bb1afef0fed323.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_9f265320faf5f8b6caeec8d8bd92a954.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_9f265320faf5f8b6caeec8d8bd92a954.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_25f4a65f1e329d24a18665f349526734.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_25f4a65f1e329d24a18665f349526734.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_4357261508f5cc102c4fbb2bc5ce7204.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_4357261508f5cc102c4fbb2bc5ce7204.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_a146c9f90c58e29fa716746375568f03.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_a146c9f90c58e29fa716746375568f03.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_be872f4baf93d766c4ac70a655047361.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_be872f4baf93d766c4ac70a655047361.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_ad237834a2836035eb6e6190b6849f99.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_ad237834a2836035eb6e6190b6849f99.jpg already downloaded
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F21%252Ffd2121e23804150c66000a328a8a81ba%252Fpa%252FKD86114_3cffdd07789246d90a64b245609f4a31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_3cffdd07789246d90a64b245609f4a31.jpg already downloaded
2026-03-28 18:30:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55e35f26-b653-5b62-adbd-a8768fa97370, identifier: KD86114
2026-03-28 18:30:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e93735e-2da9-50ca-bf5f-bfab5874df2d with identifier: GH39731
2026-03-28 18:30:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e93735e-2da9-50ca-bf5f-bfab5874df2d with identifier: GH39731
2026-03-28 18:30:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e93735e-2da9-50ca-bf5f-bfab5874df2d with identifier: GH39731 to the API
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:34Z',
 'fuel_type': 'diesel',
 'id': '4e93735e-2da9-50ca-bf5f-bfab5874df2d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH39731',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 137933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-15',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2016}
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39731%27 HTTP/1.1" 200 None
2026-03-28 18:30:38 [auto1.de] INFO: Saving data for GH39731: {'auction_closing_time': 1774884154.0, 'created_time': 1774031491.396866, 'last_price_update_time': 1774722638.97709}
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH39731') HTTP/1.1" 204 0
2026-03-28 18:30:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH06338/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with identifier: EF75873
2026-03-28 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with identifier: EF75873
2026-03-28 18:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6eaacb14-3bca-5de9-9be6-a6bce274e6c6 with identifier: EF75873 to the API
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EF75873>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:31:34Z',
 'fuel_type': 'diesel',
 'id': '6eaacb14-3bca-5de9-9be6-a6bce274e6c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF75873',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 127242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_ea96d5b28a76f1ba669a3417f13830c6.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_1f2f1bda1bcb7c73b6d3fbbeaf3fb700.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_0e57b4e1c54138ce1878383e76f3fdd0.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_69d5a08621eda647505d6039d68f7451.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_e3e5e5bf02af97493739221d9b163ab6.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_9b7e810127518cb40cae505b2bb9586f.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_8d7f1ff742f5fd44819df009bd52de02.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_5ffb31159a389e6ef496d4f1b74915d5.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_6759b392f39dc098f1f920e3d7c11b2e.jpg',
                'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_88f0ecbfdffbbedb0a57f740a43a6bbf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_ea96d5b28a76f1ba669a3417f13830c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2792074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_1f2f1bda1bcb7c73b6d3fbbeaf3fb700.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_0e57b4e1c54138ce1878383e76f3fdd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2703814,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_69d5a08621eda647505d6039d68f7451.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2664451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_e3e5e5bf02af97493739221d9b163ab6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2398715,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_9b7e810127518cb40cae505b2bb9586f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1948169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_8d7f1ff742f5fd44819df009bd52de02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2305116,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_5ffb31159a389e6ef496d4f1b74915d5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_6759b392f39dc098f1f920e3d7c11b2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6eaacb14-3bca-5de9-9be6-a6bce274e6c6/6eaacb14-3bca-5de9-9be6-a6bce274e6c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/46/ca46f0f6d5242e3abc81991dcc589b66/pa/EF75873_88f0ecbfdffbbedb0a57f740a43a6bbf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Lounge 4Motion BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge 4Motion BlueMotion Tech',
 'year': 2015}
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF75873%27 HTTP/1.1" 200 None
2026-03-28 18:30:39 [auto1.de] INFO: Saving data for EF75873: {'created_time': 1774722639.443115, 'last_price_update_time': 1774722639.443128, 'auction_closing_time': 1774884694.0}
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EF75873') HTTP/1.1" 204 0
2026-03-28 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55e35f26-b653-5b62-adbd-a8768fa97370 with identifier: KD86114
2026-03-28 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55e35f26-b653-5b62-adbd-a8768fa97370 with identifier: KD86114
2026-03-28 18:30:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55e35f26-b653-5b62-adbd-a8768fa97370 with identifier: KD86114 to the API
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KD86114>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:48:09Z',
 'fuel_type': 'petrol',
 'id': '55e35f26-b653-5b62-adbd-a8768fa97370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD86114',
 'listing': 'auction',
 'location': 'Frankfurt',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 82108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_d1afd96ead17a6ccfe020dd1160f2421.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_a4709c3aafa4e2e09f45909d5d94b654.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_28785c96e1a288d029bb1afef0fed323.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_9f265320faf5f8b6caeec8d8bd92a954.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_25f4a65f1e329d24a18665f349526734.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_4357261508f5cc102c4fbb2bc5ce7204.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_a146c9f90c58e29fa716746375568f03.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_be872f4baf93d766c4ac70a655047361.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_ad237834a2836035eb6e6190b6849f99.jpg',
                'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_3cffdd07789246d90a64b245609f4a31.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2801302,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_d1afd96ead17a6ccfe020dd1160f2421.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_a4709c3aafa4e2e09f45909d5d94b654.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726420,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_28785c96e1a288d029bb1afef0fed323.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_9f265320faf5f8b6caeec8d8bd92a954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643730,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_25f4a65f1e329d24a18665f349526734.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2697684,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_4357261508f5cc102c4fbb2bc5ce7204.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_a146c9f90c58e29fa716746375568f03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2830936,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_be872f4baf93d766c4ac70a655047361.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_ad237834a2836035eb6e6190b6849f99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55e35f26-b653-5b62-adbd-a8768fa97370/55e35f26-b653-5b62-adbd-a8768fa97370_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2636694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/21/fd2121e23804150c66000a328a8a81ba/pa/KD86114_3cffdd07789246d90a64b245609f4a31.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 Mild-Hybrid Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD86114%27 HTTP/1.1" 200 None
2026-03-28 18:30:39 [auto1.de] INFO: Saving data for KD86114: {'created_time': 1774722639.79624, 'last_price_update_time': 1774722639.796251, 'auction_closing_time': 1774885689.0}
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD86114') HTTP/1.1" 204 0
2026-03-28 18:30:39 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-28 18:30:39 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-28 18:30:39 [auto1.de] INFO: Scrape type for SN42334: 2
2026-03-28 18:30:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9a04f92-8da5-5119-9d06-b55f448c66b4 with identifier: SN42334
2026-03-28 18:30:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9a04f92-8da5-5119-9d06-b55f448c66b4 with scrape type 2
2026-03-28 18:30:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9a04f92-8da5-5119-9d06-b55f448c66b4 with scrape type 2
2026-03-28 18:30:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9a04f92-8da5-5119-9d06-b55f448c66b4, identifier: SN42334
2026-03-28 18:30:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9a04f92-8da5-5119-9d06-b55f448c66b4 with identifier: SN42334
2026-03-28 18:30:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9a04f92-8da5-5119-9d06-b55f448c66b4 with identifier: SN42334
2026-03-28 18:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9a04f92-8da5-5119-9d06-b55f448c66b4 with identifier: SN42334 to the API
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:54:56Z',
 'fuel_type': 'diesel',
 'id': 'c9a04f92-8da5-5119-9d06-b55f448c66b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN42334',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 125291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-16',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2018}
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN42334%27 HTTP/1.1" 200 None
2026-03-28 18:30:40 [auto1.de] INFO: Saving data for SN42334: {'auction_closing_time': 1774886096.0, 'created_time': 1773466752.964476, 'last_price_update_time': 1774722640.261164}
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN42334') HTTP/1.1" 204 0
2026-03-28 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF07068> (referer: https://www.auto1.com/v1/car-details-view/RF07068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:40 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-28 18:30:40 [auto1.de] INFO: Scrape type for NV30450: 1
2026-03-28 18:30:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ55109> (referer: https://www.auto1.com/v1/car-details-view/HZ55109/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:40 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 5992 | hits on page: 40
2026-03-28 18:30:40 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-28 18:30:40 [auto1.de] INFO: Scrape type for ZW50012: 2
2026-03-28 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c98b61e-0691-5631-850f-217bff1d1d90 with identifier: ZW50012
2026-03-28 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c98b61e-0691-5631-850f-217bff1d1d90 with scrape type 2
2026-03-28 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c98b61e-0691-5631-850f-217bff1d1d90 with scrape type 2
2026-03-28 18:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c98b61e-0691-5631-850f-217bff1d1d90, identifier: ZW50012
2026-03-28 18:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c98b61e-0691-5631-850f-217bff1d1d90 with identifier: ZW50012
2026-03-28 18:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c98b61e-0691-5631-850f-217bff1d1d90 with identifier: ZW50012
2026-03-28 18:30:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c98b61e-0691-5631-850f-217bff1d1d90 with identifier: ZW50012 to the API
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:37:15Z',
 'fuel_type': 'diesel',
 'id': '9c98b61e-0691-5631-850f-217bff1d1d90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW50012',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery Sport',
 'odometer': 129150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-23',
 'seller_name': None,
 'title': 'Land Rover Discovery Sport 2.0 Td4 HSE',
 'transmission': 'automatic',
 'trim': 'HSE',
 'year': 2015}
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW50012%27 HTTP/1.1" 200 None
2026-03-28 18:30:40 [auto1.de] INFO: Saving data for ZW50012: {'auction_closing_time': 1774885035.0, 'created_time': 1774118398.942037, 'last_price_update_time': 1774722640.773823}
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW50012') HTTP/1.1" 204 0
2026-03-28 18:30:40 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-28 18:30:40 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-28 18:30:40 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-28 18:30:40 [auto1.de] INFO: Scrape type for DC32299: 2
2026-03-28 18:30:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7915730f-c15d-576d-8a6e-4ddc67d0107c with identifier: DC32299
2026-03-28 18:30:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7915730f-c15d-576d-8a6e-4ddc67d0107c with scrape type 2
2026-03-28 18:30:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7915730f-c15d-576d-8a6e-4ddc67d0107c with scrape type 2
2026-03-28 18:30:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7915730f-c15d-576d-8a6e-4ddc67d0107c, identifier: DC32299
2026-03-28 18:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:40 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-28 18:30:40 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-28 18:30:40 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-28 18:30:40 [auto1.de] INFO: Scrape type for AB49133: 1
2026-03-28 18:30:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7915730f-c15d-576d-8a6e-4ddc67d0107c with identifier: DC32299
2026-03-28 18:30:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7915730f-c15d-576d-8a6e-4ddc67d0107c with identifier: DC32299
2026-03-28 18:30:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7915730f-c15d-576d-8a6e-4ddc67d0107c with identifier: DC32299 to the API
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:59:17Z',
 'fuel_type': 'diesel',
 'id': '7915730f-c15d-576d-8a6e-4ddc67d0107c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC32299',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 147831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2012}
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC32299%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [auto1.de] INFO: Saving data for DC32299: {'auction_closing_time': 1774886357.0, 'created_time': 1773426755.346334, 'last_price_update_time': 1774722641.266665}
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC32299') HTTP/1.1" 204 0
2026-03-28 18:30:41 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-28 18:30:41 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-28 18:30:41 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [auto1.de] INFO: Scrape type for ZM10504: 2
2026-03-28 18:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa9a5f40-85ed-5712-8522-5c8c0085619c with identifier: ZM10504
2026-03-28 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa9a5f40-85ed-5712-8522-5c8c0085619c with scrape type 2
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa9a5f40-85ed-5712-8522-5c8c0085619c with scrape type 2
2026-03-28 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa9a5f40-85ed-5712-8522-5c8c0085619c, identifier: ZM10504
2026-03-28 18:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2063cac8-c1b4-5c1b-8468-825f8883353a with identifier: RF07068
2026-03-28 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2063cac8-c1b4-5c1b-8468-825f8883353a with scrape type 1
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2063cac8-c1b4-5c1b-8468-825f8883353a
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_9b18b0aca3bf15bff535a5c1cb5d5f6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_9b18b0aca3bf15bff535a5c1cb5d5f6f.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_5c45d2847b1dfefff9184e2cbc72b57b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_5c45d2847b1dfefff9184e2cbc72b57b.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_272943b4ee1b5b53aa7419f3315a4c88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_272943b4ee1b5b53aa7419f3315a4c88.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_1337caf853d5d20af57ec6253d73e8b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_1337caf853d5d20af57ec6253d73e8b5.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_3c56bcf4c3b4191fff32cdaf6329c3bc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_3c56bcf4c3b4191fff32cdaf6329c3bc.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_a1ff108207fb5fff8a942012aa41988d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_a1ff108207fb5fff8a942012aa41988d.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_1cc11bf949f7a849d1b9045ed0d6f76f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_1cc11bf949f7a849d1b9045ed0d6f76f.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_728bbb7a207304e4e73034f27931353a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_728bbb7a207304e4e73034f27931353a.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_eda3e80b3d8597fba81c35cb5a3aa1a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_eda3e80b3d8597fba81c35cb5a3aa1a2.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1a%252Fe31a62e3047b0b56d2f52d85524eeb1e%252Fpa%252FRF07068_61cba0404c8062832b4f70ba0e9cc1be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_61cba0404c8062832b4f70ba0e9cc1be.jpg already downloaded
2026-03-28 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2063cac8-c1b4-5c1b-8468-825f8883353a, identifier: RF07068
2026-03-28 18:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd83c5e-9672-54e2-a4b9-29b0de5c1374 with identifier: HZ55109
2026-03-28 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd83c5e-9672-54e2-a4b9-29b0de5c1374 with scrape type 1
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efd83c5e-9672-54e2-a4b9-29b0de5c1374
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_2e9e41a50bfc4cc3f5e9076187752ea3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_2e9e41a50bfc4cc3f5e9076187752ea3.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_83b5e7e9f8dd726e8045b4acbeedbea3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_83b5e7e9f8dd726e8045b4acbeedbea3.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_ad3650a33d44bab261b4f694e902a9e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_ad3650a33d44bab261b4f694e902a9e8.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_f400d58ec5b8407eb45468526fe2c9c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_f400d58ec5b8407eb45468526fe2c9c9.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_86b11d58d650b6a19e5fabc4bde6a49d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_86b11d58d650b6a19e5fabc4bde6a49d.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_98f438cdb072c23e93a532ecae4ea4ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_98f438cdb072c23e93a532ecae4ea4ff.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_26b72fb7aceb85db147e0f39d492c3d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_26b72fb7aceb85db147e0f39d492c3d1.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_b74cdf22049c0bfcc4e10e1cf6f7ac21.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_b74cdf22049c0bfcc4e10e1cf6f7ac21.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_d1e964e0ad0445e69999ab593adf744c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_d1e964e0ad0445e69999ab593adf744c.jpg already downloaded
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fa7%252Fc6a743d4356cca4d33e474c6f4b7d263%252Fpa%252FHZ55109_b574f8bbb7abe016ec744d277fb7c80c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_b574f8bbb7abe016ec744d277fb7c80c.jpg already downloaded
2026-03-28 18:30:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efd83c5e-9672-54e2-a4b9-29b0de5c1374, identifier: HZ55109
2026-03-28 18:30:41 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-28 18:30:41 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-28 18:30:41 [auto1.de] INFO: Scrape type for KB67170: 2
2026-03-28 18:30:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with identifier: KB67170
2026-03-28 18:30:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with scrape type 2
2026-03-28 18:30:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with scrape type 2
2026-03-28 18:30:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2, identifier: KB67170
2026-03-28 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa9a5f40-85ed-5712-8522-5c8c0085619c with identifier: ZM10504
2026-03-28 18:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa9a5f40-85ed-5712-8522-5c8c0085619c with identifier: ZM10504
2026-03-28 18:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa9a5f40-85ed-5712-8522-5c8c0085619c with identifier: ZM10504 to the API
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:17:12Z',
 'fuel_type': 'petrol',
 'id': 'fa9a5f40-85ed-5712-8522-5c8c0085619c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM10504',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 35491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-13',
 'seller_name': None,
 'title': 'BMW X4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM10504%27 HTTP/1.1" 200 None
2026-03-28 18:30:42 [auto1.de] INFO: Saving data for ZM10504: {'auction_closing_time': 1774883832.0, 'created_time': 1773342217.629764, 'last_price_update_time': 1774722642.392734}
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM10504') HTTP/1.1" 204 0
2026-03-28 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2063cac8-c1b4-5c1b-8468-825f8883353a with identifier: RF07068
2026-03-28 18:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2063cac8-c1b4-5c1b-8468-825f8883353a with identifier: RF07068
2026-03-28 18:30:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2063cac8-c1b4-5c1b-8468-825f8883353a with identifier: RF07068 to the API
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RF07068>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:17:31Z',
 'fuel_type': 'petrol',
 'id': '2063cac8-c1b4-5c1b-8468-825f8883353a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF07068',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 152347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_9b18b0aca3bf15bff535a5c1cb5d5f6f.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_5c45d2847b1dfefff9184e2cbc72b57b.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_272943b4ee1b5b53aa7419f3315a4c88.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_1337caf853d5d20af57ec6253d73e8b5.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_3c56bcf4c3b4191fff32cdaf6329c3bc.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_a1ff108207fb5fff8a942012aa41988d.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_1cc11bf949f7a849d1b9045ed0d6f76f.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_728bbb7a207304e4e73034f27931353a.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_eda3e80b3d8597fba81c35cb5a3aa1a2.jpg',
                'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_61cba0404c8062832b4f70ba0e9cc1be.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79552,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_9b18b0aca3bf15bff535a5c1cb5d5f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_5c45d2847b1dfefff9184e2cbc72b57b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_272943b4ee1b5b53aa7419f3315a4c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_1337caf853d5d20af57ec6253d73e8b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_3c56bcf4c3b4191fff32cdaf6329c3bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_a1ff108207fb5fff8a942012aa41988d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_1cc11bf949f7a849d1b9045ed0d6f76f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2633724,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_728bbb7a207304e4e73034f27931353a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_eda3e80b3d8597fba81c35cb5a3aa1a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2063cac8-c1b4-5c1b-8468-825f8883353a/2063cac8-c1b4-5c1b-8468-825f8883353a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81695,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1a/e31a62e3047b0b56d2f52d85524eeb1e/pa/RF07068_61cba0404c8062832b4f70ba0e9cc1be.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF07068%27 HTTP/1.1" 200 None
2026-03-28 18:30:42 [auto1.de] INFO: Saving data for RF07068: {'created_time': 1774722642.915174, 'last_price_update_time': 1774722642.915186, 'auction_closing_time': 1774883851.0}
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF07068') HTTP/1.1" 204 0
2026-03-28 18:30:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efd83c5e-9672-54e2-a4b9-29b0de5c1374 with identifier: HZ55109
2026-03-28 18:30:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efd83c5e-9672-54e2-a4b9-29b0de5c1374 with identifier: HZ55109
2026-03-28 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efd83c5e-9672-54e2-a4b9-29b0de5c1374 with identifier: HZ55109 to the API
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HZ55109>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:18:01Z',
 'fuel_type': 'diesel',
 'id': 'efd83c5e-9672-54e2-a4b9-29b0de5c1374',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ55109',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 152317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_2e9e41a50bfc4cc3f5e9076187752ea3.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_83b5e7e9f8dd726e8045b4acbeedbea3.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_ad3650a33d44bab261b4f694e902a9e8.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_f400d58ec5b8407eb45468526fe2c9c9.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_86b11d58d650b6a19e5fabc4bde6a49d.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_98f438cdb072c23e93a532ecae4ea4ff.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_26b72fb7aceb85db147e0f39d492c3d1.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_b74cdf22049c0bfcc4e10e1cf6f7ac21.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_d1e964e0ad0445e69999ab593adf744c.jpg',
                'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_b574f8bbb7abe016ec744d277fb7c80c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_2e9e41a50bfc4cc3f5e9076187752ea3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_83b5e7e9f8dd726e8045b4acbeedbea3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74639,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_ad3650a33d44bab261b4f694e902a9e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_f400d58ec5b8407eb45468526fe2c9c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_86b11d58d650b6a19e5fabc4bde6a49d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_98f438cdb072c23e93a532ecae4ea4ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_26b72fb7aceb85db147e0f39d492c3d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_b74cdf22049c0bfcc4e10e1cf6f7ac21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_d1e964e0ad0445e69999ab593adf744c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_efd83c5e-9672-54e2-a4b9-29b0de5c1374/efd83c5e-9672-54e2-a4b9-29b0de5c1374_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/a7/c6a743d4356cca4d33e474c6f4b7d263/pa/HZ55109_b574f8bbb7abe016ec744d277fb7c80c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ55109%27 HTTP/1.1" 200 None
2026-03-28 18:30:43 [auto1.de] INFO: Saving data for HZ55109: {'created_time': 1774722643.26327, 'last_price_update_time': 1774722643.263281, 'auction_closing_time': 1774883881.0}
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ55109') HTTP/1.1" 204 0
2026-03-28 18:30:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with identifier: KB67170
2026-03-28 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with identifier: KB67170
2026-03-28 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94dbc75b-b6b7-591b-aa58-96c9ebd742e2 with identifier: KB67170 to the API
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'diesel',
 'id': '94dbc75b-b6b7-591b-aa58-96c9ebd742e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB67170',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 150844,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-04',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Design ultra',
 'transmission': 'automatic',
 'trim': 'Design ultra',
 'year': 2017}
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB67170%27 HTTP/1.1" 200 None
2026-03-28 18:30:43 [auto1.de] INFO: Saving data for KB67170: {'auction_closing_time': 1774885762.0, 'created_time': 1774349517.016865, 'last_price_update_time': 1774722643.598051}
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB67170') HTTP/1.1" 204 0
2026-03-28 18:30:43 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-28 18:30:43 [auto1.de] INFO: Scrape type for CH24864: 2
2026-03-28 18:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78bfc106-c780-5946-bffd-9834507f31fc with identifier: CH24864
2026-03-28 18:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78bfc106-c780-5946-bffd-9834507f31fc with scrape type 2
2026-03-28 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78bfc106-c780-5946-bffd-9834507f31fc with scrape type 2
2026-03-28 18:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78bfc106-c780-5946-bffd-9834507f31fc, identifier: CH24864
2026-03-28 18:30:43 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-28 18:30:43 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-28 18:30:43 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-28 18:30:43 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-28 18:30:43 [auto1.de] INFO: Scrape type for KF93262: 2
2026-03-28 18:30:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b95a52-fde9-5420-befe-cef72bed20e2 with identifier: KF93262
2026-03-28 18:30:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b95a52-fde9-5420-befe-cef72bed20e2 with scrape type 2
2026-03-28 18:30:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b95a52-fde9-5420-befe-cef72bed20e2 with scrape type 2
2026-03-28 18:30:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38b95a52-fde9-5420-befe-cef72bed20e2, identifier: KF93262
2026-03-28 18:30:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78bfc106-c780-5946-bffd-9834507f31fc with identifier: CH24864
2026-03-28 18:30:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78bfc106-c780-5946-bffd-9834507f31fc with identifier: CH24864
2026-03-28 18:30:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78bfc106-c780-5946-bffd-9834507f31fc with identifier: CH24864 to the API
2026-03-28 18:30:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:20:06Z',
 'fuel_type': 'diesel',
 'id': '78bfc106-c780-5946-bffd-9834507f31fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH24864',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 144398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.6 TDI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2014}
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH24864%27 HTTP/1.1" 200 None
2026-03-28 18:30:44 [auto1.de] INFO: Saving data for CH24864: {'auction_closing_time': 1774884006.0, 'created_time': 1773307520.507692, 'last_price_update_time': 1774722644.1931}
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH24864') HTTP/1.1" 204 0
2026-03-28 18:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38b95a52-fde9-5420-befe-cef72bed20e2 with identifier: KF93262
2026-03-28 18:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38b95a52-fde9-5420-befe-cef72bed20e2 with identifier: KF93262
2026-03-28 18:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38b95a52-fde9-5420-befe-cef72bed20e2 with identifier: KF93262 to the API
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:14:54Z',
 'fuel_type': 'petrol',
 'id': '38b95a52-fde9-5420-befe-cef72bed20e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF93262',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 16845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid GT-Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT-Line 4WD',
 'year': 2022}
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF93262%27 HTTP/1.1" 200 None
2026-03-28 18:30:44 [auto1.de] INFO: Saving data for KF93262: {'auction_closing_time': 1774883694.0, 'created_time': 1773688856.544371, 'last_price_update_time': 1774722644.545892}
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF93262') HTTP/1.1" 204 0
2026-03-28 18:30:44 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-28 18:30:44 [auto1.de] INFO: Scrape type for NA60022: 2
2026-03-28 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 740b1dce-a97b-5678-9e81-426376ce14eb with identifier: NA60022
2026-03-28 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 740b1dce-a97b-5678-9e81-426376ce14eb with scrape type 2
2026-03-28 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 740b1dce-a97b-5678-9e81-426376ce14eb with scrape type 2
2026-03-28 18:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 740b1dce-a97b-5678-9e81-426376ce14eb, identifier: NA60022
2026-03-28 18:30:44 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-28 18:30:44 [auto1.de] INFO: Scrape type for BP80209: 2
2026-03-28 18:30:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcd7a310-fb5e-5995-a51b-493598e6e4f2 with identifier: BP80209
2026-03-28 18:30:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcd7a310-fb5e-5995-a51b-493598e6e4f2 with scrape type 2
2026-03-28 18:30:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcd7a310-fb5e-5995-a51b-493598e6e4f2 with scrape type 2
2026-03-28 18:30:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcd7a310-fb5e-5995-a51b-493598e6e4f2, identifier: BP80209
2026-03-28 18:30:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 740b1dce-a97b-5678-9e81-426376ce14eb with identifier: NA60022
2026-03-28 18:30:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 740b1dce-a97b-5678-9e81-426376ce14eb with identifier: NA60022
2026-03-28 18:30:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 740b1dce-a97b-5678-9e81-426376ce14eb with identifier: NA60022 to the API
2026-03-28 18:30:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:34:48Z',
 'fuel_type': 'diesel',
 'id': '740b1dce-a97b-5678-9e81-426376ce14eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA60022',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 201290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-28',
 'seller_name': None,
 'title': 'Kia Optima 1.7 CRDi Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2012}
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA60022%27 HTTP/1.1" 200 None
2026-03-28 18:30:45 [auto1.de] INFO: Saving data for NA60022: {'auction_closing_time': 1774884888.0, 'created_time': 1774032572.407129, 'last_price_update_time': 1774722645.2163}
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA60022') HTTP/1.1" 204 0
2026-03-28 18:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcd7a310-fb5e-5995-a51b-493598e6e4f2 with identifier: BP80209
2026-03-28 18:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcd7a310-fb5e-5995-a51b-493598e6e4f2 with identifier: BP80209
2026-03-28 18:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcd7a310-fb5e-5995-a51b-493598e6e4f2 with identifier: BP80209 to the API
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:49:18Z',
 'fuel_type': 'petrol',
 'id': 'dcd7a310-fb5e-5995-a51b-493598e6e4f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP80209',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 171473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-21',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP80209%27 HTTP/1.1" 200 None
2026-03-28 18:30:45 [auto1.de] INFO: Saving data for BP80209: {'auction_closing_time': 1774885758.0, 'created_time': 1774031452.909335, 'last_price_update_time': 1774722645.55981}
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP80209') HTTP/1.1" 204 0
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-28 18:30:45 [auto1.de] INFO: Scrape type for AK26500: 1
2026-03-28 18:30:45 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-28 18:30:45 [auto1.de] INFO: Scrape type for FR18143: 2
2026-03-28 18:30:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fdcbaa4-7735-542e-ab36-ac8d47184bed with identifier: FR18143
2026-03-28 18:30:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fdcbaa4-7735-542e-ab36-ac8d47184bed with scrape type 2
2026-03-28 18:30:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fdcbaa4-7735-542e-ab36-ac8d47184bed with scrape type 2
2026-03-28 18:30:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fdcbaa4-7735-542e-ab36-ac8d47184bed, identifier: FR18143
2026-03-28 18:30:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fdcbaa4-7735-542e-ab36-ac8d47184bed with identifier: FR18143
2026-03-28 18:30:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fdcbaa4-7735-542e-ab36-ac8d47184bed with identifier: FR18143
2026-03-28 18:30:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fdcbaa4-7735-542e-ab36-ac8d47184bed with identifier: FR18143 to the API
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:49Z',
 'fuel_type': 'diesel',
 'id': '8fdcbaa4-7735-542e-ab36-ac8d47184bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR18143',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 179458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Cup 4Motion BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup 4Motion BlueMotion Tech',
 'year': 2014}
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR18143%27 HTTP/1.1" 200 None
2026-03-28 18:30:46 [auto1.de] INFO: Saving data for FR18143: {'auction_closing_time': 1774884769.0, 'created_time': 1773466966.625343, 'last_price_update_time': 1774722646.069171}
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR18143') HTTP/1.1" 204 0
2026-03-28 18:30:46 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-28 18:30:46 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-28 18:30:46 [auto1.de] INFO: Scrape type for JL32962: 2
2026-03-28 18:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 959253b2-3db3-5285-a76d-48a35f6ed41e with identifier: JL32962
2026-03-28 18:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 959253b2-3db3-5285-a76d-48a35f6ed41e with scrape type 2
2026-03-28 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 959253b2-3db3-5285-a76d-48a35f6ed41e with scrape type 2
2026-03-28 18:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 959253b2-3db3-5285-a76d-48a35f6ed41e, identifier: JL32962
2026-03-28 18:30:46 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-28 18:30:46 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-28 18:30:46 [auto1.de] INFO: Scrape type for WF13702: 2
2026-03-28 18:30:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b93079-d8ef-514e-b48b-9507cef89d03 with identifier: WF13702
2026-03-28 18:30:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b93079-d8ef-514e-b48b-9507cef89d03 with scrape type 2
2026-03-28 18:30:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44b93079-d8ef-514e-b48b-9507cef89d03 with scrape type 2
2026-03-28 18:30:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44b93079-d8ef-514e-b48b-9507cef89d03, identifier: WF13702
2026-03-28 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 959253b2-3db3-5285-a76d-48a35f6ed41e with identifier: JL32962
2026-03-28 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 959253b2-3db3-5285-a76d-48a35f6ed41e with identifier: JL32962
2026-03-28 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 959253b2-3db3-5285-a76d-48a35f6ed41e with identifier: JL32962 to the API
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:13:21Z',
 'fuel_type': 'petrol',
 'id': '959253b2-3db3-5285-a76d-48a35f6ed41e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL32962',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 147958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-31',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2014}
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL32962%27 HTTP/1.1" 200 None
2026-03-28 18:30:46 [auto1.de] INFO: Saving data for JL32962: {'auction_closing_time': 1774883601.0, 'created_time': 1774349702.857531, 'last_price_update_time': 1774722646.717216}
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL32962') HTTP/1.1" 204 0
2026-03-28 18:30:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SL92984/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44b93079-d8ef-514e-b48b-9507cef89d03 with identifier: WF13702
2026-03-28 18:30:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44b93079-d8ef-514e-b48b-9507cef89d03 with identifier: WF13702
2026-03-28 18:30:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44b93079-d8ef-514e-b48b-9507cef89d03 with identifier: WF13702 to the API
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:30:07Z',
 'fuel_type': 'diesel',
 'id': '44b93079-d8ef-514e-b48b-9507cef89d03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF13702',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea XL',
 'odometer': 306506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-10',
 'seller_name': None,
 'title': 'Seat Altea XL 1.9 TDI Stylance Style',
 'transmission': 'automatic',
 'trim': 'Stylance Style',
 'year': 2009}
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF13702%27 HTTP/1.1" 200 None
2026-03-28 18:30:47 [auto1.de] INFO: Saving data for WF13702: {'auction_closing_time': 1774884607.0, 'created_time': 1774350240.644642, 'last_price_update_time': 1774722647.076746}
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF13702') HTTP/1.1" 204 0
2026-03-28 18:30:47 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-28 18:30:47 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-28 18:30:47 [auto1.de] INFO: Scrape type for UN88738: 2
2026-03-28 18:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with identifier: UN88738
2026-03-28 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with scrape type 2
2026-03-28 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with scrape type 2
2026-03-28 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dca795a-8fe7-5cea-b20a-9ae3ca162183, identifier: UN88738
2026-03-28 18:30:47 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-28 18:30:47 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-28 18:30:47 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-28 18:30:47 [auto1.de] INFO: Scrape type for HH06006: 1
2026-03-28 18:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with identifier: UN88738
2026-03-28 18:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with identifier: UN88738
2026-03-28 18:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dca795a-8fe7-5cea-b20a-9ae3ca162183 with identifier: UN88738 to the API
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:06:01Z',
 'fuel_type': 'petrol',
 'id': '2dca795a-8fe7-5cea-b20a-9ae3ca162183',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN88738',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 111511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN88738%27 HTTP/1.1" 200 None
2026-03-28 18:30:47 [auto1.de] INFO: Saving data for UN88738: {'auction_closing_time': 1774883161.0, 'created_time': 1774118564.743006, 'last_price_update_time': 1774722647.561025}
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN88738') HTTP/1.1" 204 0
2026-03-28 18:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:47 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-28 18:30:47 [auto1.de] INFO: Scrape type for TV18525: 2
2026-03-28 18:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8fa06fc-7154-5d7b-b482-d82a0a07c22e with identifier: TV18525
2026-03-28 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8fa06fc-7154-5d7b-b482-d82a0a07c22e with scrape type 2
2026-03-28 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8fa06fc-7154-5d7b-b482-d82a0a07c22e with scrape type 2
2026-03-28 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8fa06fc-7154-5d7b-b482-d82a0a07c22e, identifier: TV18525
2026-03-28 18:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV30450/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH06338> (referer: https://www.auto1.com/v1/car-details-view/NH06338/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:47 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-28 18:30:47 [auto1.de] INFO: Scrape type for LU46217: 2
2026-03-28 18:30:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d079c23d-61ee-5a3b-a0ed-9397f374f6ff with identifier: LU46217
2026-03-28 18:30:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d079c23d-61ee-5a3b-a0ed-9397f374f6ff with scrape type 2
2026-03-28 18:30:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d079c23d-61ee-5a3b-a0ed-9397f374f6ff with scrape type 2
2026-03-28 18:30:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d079c23d-61ee-5a3b-a0ed-9397f374f6ff, identifier: LU46217
2026-03-28 18:30:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8fa06fc-7154-5d7b-b482-d82a0a07c22e with identifier: TV18525
2026-03-28 18:30:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8fa06fc-7154-5d7b-b482-d82a0a07c22e with identifier: TV18525
2026-03-28 18:30:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8fa06fc-7154-5d7b-b482-d82a0a07c22e with identifier: TV18525 to the API
2026-03-28 18:30:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:14:50Z',
 'fuel_type': 'petrol',
 'id': 'e8fa06fc-7154-5d7b-b482-d82a0a07c22e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV18525',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 126826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18525%27 HTTP/1.1" 200 None
2026-03-28 18:30:48 [auto1.de] INFO: Saving data for TV18525: {'auction_closing_time': 1774883690.0, 'created_time': 1774002859.995886, 'last_price_update_time': 1774722648.143064}
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV18525') HTTP/1.1" 204 0
2026-03-28 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d079c23d-61ee-5a3b-a0ed-9397f374f6ff with identifier: LU46217
2026-03-28 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d079c23d-61ee-5a3b-a0ed-9397f374f6ff with identifier: LU46217
2026-03-28 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d079c23d-61ee-5a3b-a0ed-9397f374f6ff with identifier: LU46217 to the API
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:17:08Z',
 'fuel_type': 'petrol',
 'id': 'd079c23d-61ee-5a3b-a0ed-9397f374f6ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU46217',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 92255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-23',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU46217%27 HTTP/1.1" 200 None
2026-03-28 18:30:48 [auto1.de] INFO: Saving data for LU46217: {'auction_closing_time': 1774883828.0, 'created_time': 1774033351.188739, 'last_price_update_time': 1774722648.561186}
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU46217') HTTP/1.1" 204 0
2026-03-28 18:30:48 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-28 18:30:48 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-28 18:30:48 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-28 18:30:48 [auto1.de] INFO: Scrape type for MU81714: 2
2026-03-28 18:30:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with identifier: MU81714
2026-03-28 18:30:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with scrape type 2
2026-03-28 18:30:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with scrape type 2
2026-03-28 18:30:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62954f82-d7c0-52a6-9d78-fda0b5da12b5, identifier: MU81714
2026-03-28 18:30:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB49133/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:48 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-28 18:30:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with identifier: MU81714
2026-03-28 18:30:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with identifier: MU81714
2026-03-28 18:30:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62954f82-d7c0-52a6-9d78-fda0b5da12b5 with identifier: MU81714 to the API
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:40:44Z',
 'fuel_type': 'petrol',
 'id': '62954f82-d7c0-52a6-9d78-fda0b5da12b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU81714',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 178187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 High up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'High  BlueMotion Tech',
 'year': 2012}
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU81714%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [auto1.de] INFO: Saving data for MU81714: {'auction_closing_time': 1774885244.0, 'created_time': 1773428053.820549, 'last_price_update_time': 1774722649.031786}
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU81714') HTTP/1.1" 204 0
2026-03-28 18:30:49 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [auto1.de] INFO: Scrape type for ZL07582: 1
2026-03-28 18:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:49 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 5992 | hits on page: 40
2026-03-28 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with identifier: NH06338
2026-03-28 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with scrape type 1
2026-03-28 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F6f%252Fe86fc39b98fc463e9d9c8a03c89c520a%252Fpa%252FNH06338_d987f7c12f1820bcc8a318dadee14842.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_d987f7c12f1820bcc8a318dadee14842.jpg already downloaded
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F6f%252Fe86fc39b98fc463e9d9c8a03c89c520a%252Fpa%252FNH06338_a3a799a6ddd406e07c5b333b41ad33be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_a3a799a6ddd406e07c5b333b41ad33be.jpg already downloaded
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F6f%252Fe86fc39b98fc463e9d9c8a03c89c520a%252Fpa%252FNH06338_3ef0d98430807f2091ad0b1ab5fafb96.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_3ef0d98430807f2091ad0b1ab5fafb96.jpg already downloaded
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F6f%252Fe86fc39b98fc463e9d9c8a03c89c520a%252Fpa%252FNH06338_f4c5a06be1a5d17cc627079708f0a5dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_f4c5a06be1a5d17cc627079708f0a5dd.jpg already downloaded
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F6f%252Fe86fc39b98fc463e9d9c8a03c89c520a%252Fpa%252FNH06338_50dcfd90b0de36e828ce1ec029efde30.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_50dcfd90b0de36e828ce1ec029efde30.jpg already downloaded
2026-03-28 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1, identifier: NH06338
2026-03-28 18:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with identifier: NH06338
2026-03-28 18:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with identifier: NH06338
2026-03-28 18:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1 with identifier: NH06338 to the API
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NH06338>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:46:54Z',
 'fuel_type': 'petrol',
 'id': '6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH06338',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 114547,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_d987f7c12f1820bcc8a318dadee14842.jpg',
                'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_a3a799a6ddd406e07c5b333b41ad33be.jpg',
                'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_3ef0d98430807f2091ad0b1ab5fafb96.jpg',
                'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_f4c5a06be1a5d17cc627079708f0a5dd.jpg',
                'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_50dcfd90b0de36e828ce1ec029efde30.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1/6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_d987f7c12f1820bcc8a318dadee14842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1/6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_a3a799a6ddd406e07c5b333b41ad33be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1/6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_3ef0d98430807f2091ad0b1ab5fafb96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1/6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_f4c5a06be1a5d17cc627079708f0a5dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1/6a11bd3f-f210-5f5a-bc75-03d8a9e79ce1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/6f/e86fc39b98fc463e9d9c8a03c89c520a/pa/NH06338_50dcfd90b0de36e828ce1ec029efde30.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2009}
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH06338%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [auto1.de] INFO: Saving data for NH06338: {'created_time': 1774722649.613262, 'last_price_update_time': 1774722649.613272, 'auction_closing_time': 1774885614.0}
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH06338') HTTP/1.1" 204 0
2026-03-28 18:30:49 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [auto1.de] INFO: Scrape type for PW12377: 2
2026-03-28 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with identifier: PW12377
2026-03-28 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with scrape type 2
2026-03-28 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with scrape type 2
2026-03-28 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64, identifier: PW12377
2026-03-28 18:30:49 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-28 18:30:49 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-28 18:30:49 [auto1.de] INFO: Scrape type for SS07399: 2
2026-03-28 18:30:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with identifier: SS07399
2026-03-28 18:30:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with scrape type 2
2026-03-28 18:30:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with scrape type 2
2026-03-28 18:30:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fd68b71-2ea2-5c6f-8fad-2c670f202197, identifier: SS07399
2026-03-28 18:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with identifier: PW12377
2026-03-28 18:30:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with identifier: PW12377
2026-03-28 18:30:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40a48d21-41c3-5ba1-88fd-6e0b1f690b64 with identifier: PW12377 to the API
2026-03-28 18:30:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:23:26Z',
 'fuel_type': 'petrol',
 'id': '40a48d21-41c3-5ba1-88fd-6e0b1f690b64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW12377',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 145891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-14',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 VIP',
 'transmission': 'manual',
 'trim': 'VIP',
 'year': 2008}
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12377%27 HTTP/1.1" 200 None
2026-03-28 18:30:50 [auto1.de] INFO: Saving data for PW12377: {'auction_closing_time': 1774884206.0, 'created_time': 1774032873.022406, 'last_price_update_time': 1774722650.201484}
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW12377') HTTP/1.1" 204 0
2026-03-28 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with identifier: SS07399
2026-03-28 18:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with identifier: SS07399
2026-03-28 18:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fd68b71-2ea2-5c6f-8fad-2c670f202197 with identifier: SS07399 to the API
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:54:22Z',
 'fuel_type': 'diesel',
 'id': '5fd68b71-2ea2-5c6f-8fad-2c670f202197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS07399',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 143952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-01',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Active Start/Stop',
 'transmission': 'manual',
 'trim': 'Active Start/Stop',
 'year': 2016}
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS07399%27 HTTP/1.1" 200 None
2026-03-28 18:30:50 [auto1.de] INFO: Saving data for SS07399: {'auction_closing_time': 1774886062.0, 'created_time': 1774118481.136479, 'last_price_update_time': 1774722650.549717}
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS07399') HTTP/1.1" 204 0
2026-03-28 18:30:50 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-28 18:30:50 [auto1.de] INFO: Scrape type for RD52099: 2
2026-03-28 18:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14753852-bd0d-5025-ad91-e6700e98bfe7 with identifier: RD52099
2026-03-28 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14753852-bd0d-5025-ad91-e6700e98bfe7 with scrape type 2
2026-03-28 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14753852-bd0d-5025-ad91-e6700e98bfe7 with scrape type 2
2026-03-28 18:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14753852-bd0d-5025-ad91-e6700e98bfe7, identifier: RD52099
2026-03-28 18:30:50 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-28 18:30:50 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-28 18:30:50 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-28 18:30:50 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-28 18:30:50 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-28 18:30:50 [auto1.de] INFO: Scrape type for RR54011: 2
2026-03-28 18:30:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f449cc-28c3-5eeb-9815-0d135e2a4107 with identifier: RR54011
2026-03-28 18:30:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f449cc-28c3-5eeb-9815-0d135e2a4107 with scrape type 2
2026-03-28 18:30:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f449cc-28c3-5eeb-9815-0d135e2a4107 with scrape type 2
2026-03-28 18:30:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24f449cc-28c3-5eeb-9815-0d135e2a4107, identifier: RR54011
2026-03-28 18:30:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14753852-bd0d-5025-ad91-e6700e98bfe7 with identifier: RD52099
2026-03-28 18:30:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14753852-bd0d-5025-ad91-e6700e98bfe7 with identifier: RD52099
2026-03-28 18:30:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14753852-bd0d-5025-ad91-e6700e98bfe7 with identifier: RD52099 to the API
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:40:33Z',
 'fuel_type': 'petrol',
 'id': '14753852-bd0d-5025-ad91-e6700e98bfe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD52099',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 99970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2017}
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD52099%27 HTTP/1.1" 200 None
2026-03-28 18:30:51 [auto1.de] INFO: Saving data for RD52099: {'auction_closing_time': 1774885233.0, 'created_time': 1773991277.021232, 'last_price_update_time': 1774722651.107481}
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD52099') HTTP/1.1" 204 0
2026-03-28 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24f449cc-28c3-5eeb-9815-0d135e2a4107 with identifier: RR54011
2026-03-28 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24f449cc-28c3-5eeb-9815-0d135e2a4107 with identifier: RR54011
2026-03-28 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24f449cc-28c3-5eeb-9815-0d135e2a4107 with identifier: RR54011 to the API
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:48:05Z',
 'fuel_type': 'petrol',
 'id': '24f449cc-28c3-5eeb-9815-0d135e2a4107',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR54011',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 31735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR54011%27 HTTP/1.1" 200 None
2026-03-28 18:30:51 [auto1.de] INFO: Saving data for RR54011: {'auction_closing_time': 1774885685.0, 'created_time': 1774033521.248038, 'last_price_update_time': 1774722651.583295}
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR54011') HTTP/1.1" 204 0
2026-03-28 18:30:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK26500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:51 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-28 18:30:51 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-28 18:30:51 [auto1.de] INFO: Scrape type for CX30934: 2
2026-03-28 18:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c357b78-d2a5-52e8-aa9a-74aab652f31b with identifier: CX30934
2026-03-28 18:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c357b78-d2a5-52e8-aa9a-74aab652f31b with scrape type 2
2026-03-28 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c357b78-d2a5-52e8-aa9a-74aab652f31b with scrape type 2
2026-03-28 18:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c357b78-d2a5-52e8-aa9a-74aab652f31b, identifier: CX30934
2026-03-28 18:30:51 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-28 18:30:51 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-28 18:30:51 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL12737%27 HTTP/1.1" 200 None
2026-03-28 18:30:51 [auto1.de] INFO: Scrape type for JL12737: 0
2026-03-28 18:30:51 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-28 18:30:51 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-28 18:30:51 [auto1.de] INFO: Scrape type for KP96972: 2
2026-03-28 18:30:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e85f3df2-540f-5ab9-a951-e5f607d325ae with identifier: KP96972
2026-03-28 18:30:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85f3df2-540f-5ab9-a951-e5f607d325ae with scrape type 2
2026-03-28 18:30:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e85f3df2-540f-5ab9-a951-e5f607d325ae with scrape type 2
2026-03-28 18:30:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e85f3df2-540f-5ab9-a951-e5f607d325ae, identifier: KP96972
2026-03-28 18:30:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c357b78-d2a5-52e8-aa9a-74aab652f31b with identifier: CX30934
2026-03-28 18:30:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c357b78-d2a5-52e8-aa9a-74aab652f31b with identifier: CX30934
2026-03-28 18:30:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c357b78-d2a5-52e8-aa9a-74aab652f31b with identifier: CX30934 to the API
2026-03-28 18:30:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:44:02Z',
 'fuel_type': 'diesel',
 'id': '8c357b78-d2a5-52e8-aa9a-74aab652f31b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX30934',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 43367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-27',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2023}
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX30934%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Saving data for CX30934: {'auction_closing_time': 1774885442.0, 'created_time': 1774033674.262523, 'last_price_update_time': 1774722652.169071}
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX30934') HTTP/1.1" 204 0
2026-03-28 18:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e85f3df2-540f-5ab9-a951-e5f607d325ae with identifier: KP96972
2026-03-28 18:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e85f3df2-540f-5ab9-a951-e5f607d325ae with identifier: KP96972
2026-03-28 18:30:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e85f3df2-540f-5ab9-a951-e5f607d325ae with identifier: KP96972 to the API
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:35:52Z',
 'fuel_type': 'diesel',
 'id': 'e85f3df2-540f-5ab9-a951-e5f607d325ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP96972',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C5',
 'odometer': 269532,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-09',
 'seller_name': None,
 'title': 'Citroen C5 2.0 HDi',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP96972%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Saving data for KP96972: {'auction_closing_time': 1774884952.0, 'created_time': 1774033447.879681, 'last_price_update_time': 1774722652.506114}
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP96972') HTTP/1.1" 204 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for KT37105: 2
2026-03-28 18:30:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 227e7c38-322d-55ee-81c5-5bea705ebc49 with identifier: KT37105
2026-03-28 18:30:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227e7c38-322d-55ee-81c5-5bea705ebc49 with scrape type 2
2026-03-28 18:30:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 227e7c38-322d-55ee-81c5-5bea705ebc49 with scrape type 2
2026-03-28 18:30:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 227e7c38-322d-55ee-81c5-5bea705ebc49, identifier: KT37105
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68514%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for NX68514: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW59624%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for YW59624: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46079%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for VV46079: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM69365%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for AM69365: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW75956%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for DW75956: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB74234%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for XB74234: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR05539%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for AR05539: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS69815%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for DS69815: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR19321%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for FR19321: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS08469%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for GS08469: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG72840%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for VG72840: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF63689%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for TF63689: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD16858%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for BD16858: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH12936%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for KH12936: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU91903%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for NU91903: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG33917%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for KG33917: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD12579%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for YD12579: 0
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-28 18:30:52 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE44691%27 HTTP/1.1" 200 None
2026-03-28 18:30:52 [auto1.de] INFO: Scrape type for BE44691: 0
2026-03-28 18:30:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 227e7c38-322d-55ee-81c5-5bea705ebc49 with identifier: KT37105
2026-03-28 18:30:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 227e7c38-322d-55ee-81c5-5bea705ebc49 with identifier: KT37105
2026-03-28 18:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 227e7c38-322d-55ee-81c5-5bea705ebc49 with identifier: KT37105 to the API
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:23:34Z',
 'fuel_type': 'petrol',
 'id': '227e7c38-322d-55ee-81c5-5bea705ebc49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT37105',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Coupe',
 'odometer': 147911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-30',
 'seller_name': None,
 'title': 'MINI Coupe Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT37105%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [auto1.de] INFO: Saving data for KT37105: {'auction_closing_time': 1774884214.0, 'created_time': 1774033519.517306, 'last_price_update_time': 1774722653.302398}
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT37105') HTTP/1.1" 204 0
2026-03-28 18:30:53 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-28 18:30:53 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-28 18:30:53 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-28 18:30:53 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-28 18:30:53 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-28 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH06006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SL92984> (referer: https://www.auto1.com/v1/car-details-view/SL92984/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with identifier: SL92984
2026-03-28 18:30:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with scrape type 1
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9ca5f7a-b989-510f-bd2c-8d4365e82d2b
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_b3e28766937609e17e1e7cfcba0ef869.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_b3e28766937609e17e1e7cfcba0ef869.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_f5509d759532a4148b6156b01a13e523.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_f5509d759532a4148b6156b01a13e523.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_e04c71d5215031b332fa8420187d886f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_e04c71d5215031b332fa8420187d886f.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_d4e08f68ca323a0a9c30944a9282f65d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_d4e08f68ca323a0a9c30944a9282f65d.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_f4f552bb0c7c8d9487f2d0832d956c86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_f4f552bb0c7c8d9487f2d0832d956c86.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_4f45252b179d60e4430d7415d55e8998.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_4f45252b179d60e4430d7415d55e8998.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_232ec4c1d5339350eb091b17b1c75795.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_232ec4c1d5339350eb091b17b1c75795.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_4b55af1c14b8aae4a053b80cd6a7a11f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_4b55af1c14b8aae4a053b80cd6a7a11f.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_cb0bc09f93bc202d57f7fddf123dbb92.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_cb0bc09f93bc202d57f7fddf123dbb92.jpg already downloaded
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Fdd%252F6ddd49852a67de8d1fdc9d9d1ed0d32c%252Fpa%252FSL92984_ca084f525c13b1e2b08c3bb32ece6bb9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_ca084f525c13b1e2b08c3bb32ece6bb9.jpg already downloaded
2026-03-28 18:30:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b, identifier: SL92984
2026-03-28 18:30:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with identifier: SL92984
2026-03-28 18:30:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with identifier: SL92984
2026-03-28 18:30:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9ca5f7a-b989-510f-bd2c-8d4365e82d2b with identifier: SL92984 to the API
2026-03-28 18:30:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SL92984>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:55:56Z',
 'fuel_type': 'diesel',
 'id': 'f9ca5f7a-b989-510f-bd2c-8d4365e82d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL92984',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'BMW',
 'model': '3er',
 'odometer': 133910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_b3e28766937609e17e1e7cfcba0ef869.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_f5509d759532a4148b6156b01a13e523.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_e04c71d5215031b332fa8420187d886f.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_d4e08f68ca323a0a9c30944a9282f65d.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_f4f552bb0c7c8d9487f2d0832d956c86.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_4f45252b179d60e4430d7415d55e8998.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_232ec4c1d5339350eb091b17b1c75795.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_4b55af1c14b8aae4a053b80cd6a7a11f.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_cb0bc09f93bc202d57f7fddf123dbb92.jpg',
                'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_ca084f525c13b1e2b08c3bb32ece6bb9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_b3e28766937609e17e1e7cfcba0ef869.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_f5509d759532a4148b6156b01a13e523.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_e04c71d5215031b332fa8420187d886f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_d4e08f68ca323a0a9c30944a9282f65d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_f4f552bb0c7c8d9487f2d0832d956c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_4f45252b179d60e4430d7415d55e8998.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_232ec4c1d5339350eb091b17b1c75795.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_4b55af1c14b8aae4a053b80cd6a7a11f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_cb0bc09f93bc202d57f7fddf123dbb92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9ca5f7a-b989-510f-bd2c-8d4365e82d2b/f9ca5f7a-b989-510f-bd2c-8d4365e82d2b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/dd/6ddd49852a67de8d1fdc9d9d1ed0d32c/pa/SL92984_ca084f525c13b1e2b08c3bb32ece6bb9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 335d GT xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2016}
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL92984%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [auto1.de] INFO: Saving data for SL92984: {'created_time': 1774722654.165908, 'last_price_update_time': 1774722654.165921, 'auction_closing_time': 1774886156.0}
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL92984') HTTP/1.1" 204 0
2026-03-28 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV30450> (referer: https://www.auto1.com/v1/car-details-view/NV30450/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with identifier: NV30450
2026-03-28 18:30:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with scrape type 1
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2e3695f-b1fa-5d4e-9102-4a573089b0e8
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_63c99d68fd237364a1b6cbd933809719.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_63c99d68fd237364a1b6cbd933809719.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_c4f1e98404d63a2ca01474ce59c87a54.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_c4f1e98404d63a2ca01474ce59c87a54.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_123818b88fe9c71e797eddebe6f56219.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_123818b88fe9c71e797eddebe6f56219.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_c2f21c66095031a75ea9ebe779e9916e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_c2f21c66095031a75ea9ebe779e9916e.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_b6346ab21c4d089c0c351aba44d461a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_b6346ab21c4d089c0c351aba44d461a5.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_dd760829242a78018036100755451537.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_dd760829242a78018036100755451537.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_1495eaaa5277d47ac0ef9220b67b95fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_1495eaaa5277d47ac0ef9220b67b95fd.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_181522e049f1805aa2cca01190ec8904.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_181522e049f1805aa2cca01190ec8904.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_f3dd73d5a67db75b999ca6c940844193.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_f3dd73d5a67db75b999ca6c940844193.jpg already downloaded
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F25%252Fb02534be472b6293b8eafeed66ecd8af%252Fpa%252FNV30450_5ed2f2fe740d0bc91e6a415699192f01.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_5ed2f2fe740d0bc91e6a415699192f01.jpg already downloaded
2026-03-28 18:30:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2e3695f-b1fa-5d4e-9102-4a573089b0e8, identifier: NV30450
2026-03-28 18:30:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with identifier: NV30450
2026-03-28 18:30:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with identifier: NV30450
2026-03-28 18:30:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2e3695f-b1fa-5d4e-9102-4a573089b0e8 with identifier: NV30450 to the API
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NV30450>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:19:29Z',
 'fuel_type': 'diesel',
 'id': 'd2e3695f-b1fa-5d4e-9102-4a573089b0e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV30450',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'BMW',
 'model': '5er',
 'odometer': 239497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_63c99d68fd237364a1b6cbd933809719.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_c4f1e98404d63a2ca01474ce59c87a54.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_123818b88fe9c71e797eddebe6f56219.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_c2f21c66095031a75ea9ebe779e9916e.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_b6346ab21c4d089c0c351aba44d461a5.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_dd760829242a78018036100755451537.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_1495eaaa5277d47ac0ef9220b67b95fd.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_181522e049f1805aa2cca01190ec8904.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_f3dd73d5a67db75b999ca6c940844193.jpg',
                'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_5ed2f2fe740d0bc91e6a415699192f01.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_63c99d68fd237364a1b6cbd933809719.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_c4f1e98404d63a2ca01474ce59c87a54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_123818b88fe9c71e797eddebe6f56219.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_c2f21c66095031a75ea9ebe779e9916e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_b6346ab21c4d089c0c351aba44d461a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_dd760829242a78018036100755451537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_1495eaaa5277d47ac0ef9220b67b95fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_181522e049f1805aa2cca01190ec8904.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_f3dd73d5a67db75b999ca6c940844193.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2e3695f-b1fa-5d4e-9102-4a573089b0e8/d2e3695f-b1fa-5d4e-9102-4a573089b0e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/25/b02534be472b6293b8eafeed66ecd8af/pa/NV30450_5ed2f2fe740d0bc91e6a415699192f01.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV30450%27 HTTP/1.1" 200 None
2026-03-28 18:30:54 [auto1.de] INFO: Saving data for NV30450: {'created_time': 1774722654.968519, 'last_price_update_time': 1774722654.96853, 'auction_closing_time': 1774883969.0}
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV30450') HTTP/1.1" 204 0
2026-03-28 18:30:54 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 5992 | hits on page: 40
2026-03-28 18:30:54 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR18568%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for AR18568: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for ZK29983: 2
2026-03-28 18:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b56d7da3-1124-502e-a445-776e1972682b with identifier: ZK29983
2026-03-28 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b56d7da3-1124-502e-a445-776e1972682b with scrape type 2
2026-03-28 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b56d7da3-1124-502e-a445-776e1972682b with scrape type 2
2026-03-28 18:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b56d7da3-1124-502e-a445-776e1972682b, identifier: ZK29983
2026-03-28 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b56d7da3-1124-502e-a445-776e1972682b with identifier: ZK29983
2026-03-28 18:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b56d7da3-1124-502e-a445-776e1972682b with identifier: ZK29983
2026-03-28 18:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b56d7da3-1124-502e-a445-776e1972682b with identifier: ZK29983 to the API
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:46:56Z',
 'fuel_type': 'petrol',
 'id': 'b56d7da3-1124-502e-a445-776e1972682b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK29983',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Ignis',
 'odometer': 13388,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Suzuki Ignis 1.2 DualJet SHVS Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK29983%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Saving data for ZK29983: {'auction_closing_time': 1774885616.0, 'created_time': 1773830242.570589, 'last_price_update_time': 1774722655.434373}
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK29983') HTTP/1.1" 204 0
2026-03-28 18:30:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC63717%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for FC63717: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF63409%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for YF63409: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ82398%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for JJ82398: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT58980%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for KT58980: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF69032%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for JF69032: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP80660%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for UP80660: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV17039%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for VV17039: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU49821%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for TU49821: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK94674%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for BK94674: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE51939%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for JE51939: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL44277%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for JL44277: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS86297%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for AS86297: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR11100%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for CR11100: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC39120%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for KC39120: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM88961%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for LM88961: 0
2026-03-28 18:30:55 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-28 18:30:55 [auto1.de] INFO: Scrape type for WN56158: 2
2026-03-28 18:30:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 137851de-c891-5724-8b0d-4135704ffe21 with identifier: WN56158
2026-03-28 18:30:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 137851de-c891-5724-8b0d-4135704ffe21 with scrape type 2
2026-03-28 18:30:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 137851de-c891-5724-8b0d-4135704ffe21 with scrape type 2
2026-03-28 18:30:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 137851de-c891-5724-8b0d-4135704ffe21, identifier: WN56158
2026-03-28 18:30:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 137851de-c891-5724-8b0d-4135704ffe21 with identifier: WN56158
2026-03-28 18:30:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 137851de-c891-5724-8b0d-4135704ffe21 with identifier: WN56158
2026-03-28 18:30:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 137851de-c891-5724-8b0d-4135704ffe21 with identifier: WN56158 to the API
2026-03-28 18:30:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:16:49Z',
 'fuel_type': 'petrol',
 'id': '137851de-c891-5724-8b0d-4135704ffe21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN56158',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 109235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-02',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Center-Line 2WD',
 'transmission': 'manual',
 'trim': 'Center-Line 2WD',
 'year': 2013}
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN56158%27 HTTP/1.1" 200 None
2026-03-28 18:30:56 [auto1.de] INFO: Saving data for WN56158: {'auction_closing_time': 1774883809.0, 'created_time': 1773992660.163066, 'last_price_update_time': 1774722656.211777}
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN56158') HTTP/1.1" 204 0
2026-03-28 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH06006> (referer: https://www.auto1.com/v1/car-details-view/HH06006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK26500> (referer: https://www.auto1.com/v1/car-details-view/AK26500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB49133> (referer: https://www.auto1.com/v1/car-details-view/AB49133/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with identifier: HH06006
2026-03-28 18:30:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with scrape type 1
2026-03-28 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 22d76f29-2403-51b3-bd5e-8c363c0b1b1c
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F60%252F2260c2bafa34d2ea448dd1d55d40a35a%252Fpa%252FHH06006_65d071e31bf89d50eec2a3a6e10fce00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_65d071e31bf89d50eec2a3a6e10fce00.jpg already downloaded
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F60%252F2260c2bafa34d2ea448dd1d55d40a35a%252Fpa%252FHH06006_982d1f5e7389d202b36e1a1219157e8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_982d1f5e7389d202b36e1a1219157e8c.jpg already downloaded
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F60%252F2260c2bafa34d2ea448dd1d55d40a35a%252Fpa%252FHH06006_dbe4faaf2ea0f7abd745463561c2ab1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_dbe4faaf2ea0f7abd745463561c2ab1c.jpg already downloaded
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F60%252F2260c2bafa34d2ea448dd1d55d40a35a%252Fpa%252FHH06006_469497e315f8a39cfe937e94f4dcec4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_469497e315f8a39cfe937e94f4dcec4d.jpg already downloaded
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F60%252F2260c2bafa34d2ea448dd1d55d40a35a%252Fpa%252FHH06006_5277a9afbb231dc07a6cfdb18e811477.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_5277a9afbb231dc07a6cfdb18e811477.jpg already downloaded
2026-03-28 18:30:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c, identifier: HH06006
2026-03-28 18:30:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with identifier: HH06006
2026-03-28 18:30:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with identifier: HH06006
2026-03-28 18:30:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22d76f29-2403-51b3-bd5e-8c363c0b1b1c with identifier: HH06006 to the API
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH06006>
{'auction_title': '',
 'c_o_2_emission_value': 227,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 232,
 'expiration_date': '2026-03-30T15:44:23Z',
 'fuel_type': 'diesel',
 'id': '22d76f29-2403-51b3-bd5e-8c363c0b1b1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH06006',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 276397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_65d071e31bf89d50eec2a3a6e10fce00.jpg',
                'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_982d1f5e7389d202b36e1a1219157e8c.jpg',
                'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_dbe4faaf2ea0f7abd745463561c2ab1c.jpg',
                'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_469497e315f8a39cfe937e94f4dcec4d.jpg',
                'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_5277a9afbb231dc07a6cfdb18e811477.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d76f29-2403-51b3-bd5e-8c363c0b1b1c/22d76f29-2403-51b3-bd5e-8c363c0b1b1c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_65d071e31bf89d50eec2a3a6e10fce00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d76f29-2403-51b3-bd5e-8c363c0b1b1c/22d76f29-2403-51b3-bd5e-8c363c0b1b1c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_982d1f5e7389d202b36e1a1219157e8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d76f29-2403-51b3-bd5e-8c363c0b1b1c/22d76f29-2403-51b3-bd5e-8c363c0b1b1c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_dbe4faaf2ea0f7abd745463561c2ab1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d76f29-2403-51b3-bd5e-8c363c0b1b1c/22d76f29-2403-51b3-bd5e-8c363c0b1b1c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_469497e315f8a39cfe937e94f4dcec4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22d76f29-2403-51b3-bd5e-8c363c0b1b1c/22d76f29-2403-51b3-bd5e-8c363c0b1b1c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/60/2260c2bafa34d2ea448dd1d55d40a35a/pa/HH06006_5277a9afbb231dc07a6cfdb18e811477.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-07-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06006%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [auto1.de] INFO: Saving data for HH06006: {'created_time': 1774722657.018182, 'last_price_update_time': 1774722657.018195, 'auction_closing_time': 1774885463.0}
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH06006') HTTP/1.1" 204 0
2026-03-28 18:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-03-28 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ee2a469-befa-5607-b315-aebe1f19de9f with scrape type 1
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ee2a469-befa-5607-b315-aebe1f19de9f
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_cdb7161ba5d779bd8815e5577067db8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_cdb7161ba5d779bd8815e5577067db8a.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_05987e04552186d3b7c7bd96697fb4ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_05987e04552186d3b7c7bd96697fb4ea.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_5c10d9c41c45528fea787ebcb03eec4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_5c10d9c41c45528fea787ebcb03eec4c.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_aa0b74b6f59c512eee0d96a7427f47f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_aa0b74b6f59c512eee0d96a7427f47f4.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_4b10a962b6409b0e452db79564cc8ed6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_4b10a962b6409b0e452db79564cc8ed6.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_7d0a4a55fa6954089085273202c33751.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_7d0a4a55fa6954089085273202c33751.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_2c75cb0b3ad013c5562a37b3f4e39cf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_2c75cb0b3ad013c5562a37b3f4e39cf5.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_d5ee102da5f7be8878a765e9f3df6c0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_d5ee102da5f7be8878a765e9f3df6c0c.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252F35%252Fcb3508a8cb137d2254fe774a2c47db46%252Fpa%252FAK26500_279cc17a18fd9bcd6b494e4cde8ca9fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_279cc17a18fd9bcd6b494e4cde8ca9fe.jpg already downloaded
2026-03-28 18:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ee2a469-befa-5607-b315-aebe1f19de9f, identifier: AK26500
2026-03-28 18:30:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with identifier: AB49133
2026-03-28 18:30:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with scrape type 1
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a08c3df5-bad3-53fd-a803-10f89c4bc7c9
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_740991b90909ecd59bf8b0dd6c5d7c46.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_740991b90909ecd59bf8b0dd6c5d7c46.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_afc43b3f9a89b5f1dd3813f90c2409b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_afc43b3f9a89b5f1dd3813f90c2409b6.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_cfed8a9714700f42e9bfe3057d4c862b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_cfed8a9714700f42e9bfe3057d4c862b.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_3e34f4fab736d2e1a6dad38cf91b0115.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_3e34f4fab736d2e1a6dad38cf91b0115.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_9cf661064dee2999253814c11e70b9e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_9cf661064dee2999253814c11e70b9e0.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_fe3b130f1fb09e1f029c2e294488cec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_fe3b130f1fb09e1f029c2e294488cec8.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_fb9fe4a8cf28a6603e6013c37062ba6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_fb9fe4a8cf28a6603e6013c37062ba6e.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_d52987368d3e78b17ff21039065ec02c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_d52987368d3e78b17ff21039065ec02c.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_22fab482a19d8fe942531428bd9c2f87.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_22fab482a19d8fe942531428bd9c2f87.jpg already downloaded
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252Fa8%252Fe7a800252ef7f58c2bb3b6473c08877a%252Fpa%252FAB49133_1fcbd27b932990227ed3c81ba87df6d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_1fcbd27b932990227ed3c81ba87df6d4.jpg already downloaded
2026-03-28 18:30:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a08c3df5-bad3-53fd-a803-10f89c4bc7c9, identifier: AB49133
2026-03-28 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-03-28 18:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500
2026-03-28 18:30:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ee2a469-befa-5607-b315-aebe1f19de9f with identifier: AK26500 to the API
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AK26500>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:43Z',
 'fuel_type': 'diesel',
 'id': '1ee2a469-befa-5607-b315-aebe1f19de9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK26500',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 109381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_cdb7161ba5d779bd8815e5577067db8a.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_05987e04552186d3b7c7bd96697fb4ea.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_5c10d9c41c45528fea787ebcb03eec4c.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_aa0b74b6f59c512eee0d96a7427f47f4.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_4b10a962b6409b0e452db79564cc8ed6.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_7d0a4a55fa6954089085273202c33751.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_2c75cb0b3ad013c5562a37b3f4e39cf5.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_d5ee102da5f7be8878a765e9f3df6c0c.jpg',
                'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_279cc17a18fd9bcd6b494e4cde8ca9fe.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77868,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_cdb7161ba5d779bd8815e5577067db8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2155724,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_05987e04552186d3b7c7bd96697fb4ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78717,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_c516f57cd2db324a26bf4fdebdfcefd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2135594,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_5c10d9c41c45528fea787ebcb03eec4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2179478,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_aa0b74b6f59c512eee0d96a7427f47f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2077634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_4b10a962b6409b0e452db79564cc8ed6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_7d0a4a55fa6954089085273202c33751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_2c75cb0b3ad013c5562a37b3f4e39cf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1941008,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_d5ee102da5f7be8878a765e9f3df6c0c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1ee2a469-befa-5607-b315-aebe1f19de9f/1ee2a469-befa-5607-b315-aebe1f19de9f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2383953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/35/cb3508a8cb137d2254fe774a2c47db46/pa/AK26500_279cc17a18fd9bcd6b494e4cde8ca9fe.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-02-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK26500%27 HTTP/1.1" 200 None
2026-03-28 18:30:57 [auto1.de] INFO: Saving data for AK26500: {'created_time': 1774722657.955394, 'last_price_update_time': 1774722657.955408, 'auction_closing_time': 1774884943.0}
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK26500') HTTP/1.1" 204 0
2026-03-28 18:30:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with identifier: AB49133
2026-03-28 18:30:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with identifier: AB49133
2026-03-28 18:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a08c3df5-bad3-53fd-a803-10f89c4bc7c9 with identifier: AB49133 to the API
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AB49133>
{'auction_title': '',
 'c_o_2_emission_value': 209,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:15:55Z',
 'fuel_type': 'petrol',
 'id': 'a08c3df5-bad3-53fd-a803-10f89c4bc7c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB49133',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 153234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_740991b90909ecd59bf8b0dd6c5d7c46.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_afc43b3f9a89b5f1dd3813f90c2409b6.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_cfed8a9714700f42e9bfe3057d4c862b.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_3e34f4fab736d2e1a6dad38cf91b0115.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_9cf661064dee2999253814c11e70b9e0.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_fe3b130f1fb09e1f029c2e294488cec8.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_fb9fe4a8cf28a6603e6013c37062ba6e.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_d52987368d3e78b17ff21039065ec02c.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_22fab482a19d8fe942531428bd9c2f87.jpg',
                'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_1fcbd27b932990227ed3c81ba87df6d4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3391479,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_740991b90909ecd59bf8b0dd6c5d7c46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_afc43b3f9a89b5f1dd3813f90c2409b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2940964,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_cfed8a9714700f42e9bfe3057d4c862b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_3e34f4fab736d2e1a6dad38cf91b0115.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3354524,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_9cf661064dee2999253814c11e70b9e0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_fe3b130f1fb09e1f029c2e294488cec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2920440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_fb9fe4a8cf28a6603e6013c37062ba6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_d52987368d3e78b17ff21039065ec02c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_22fab482a19d8fe942531428bd9c2f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a08c3df5-bad3-53fd-a803-10f89c4bc7c9/a08c3df5-bad3-53fd-a803-10f89c4bc7c9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/a8/e7a800252ef7f58c2bb3b6473c08877a/pa/AB49133_1fcbd27b932990227ed3c81ba87df6d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sorento 2.4 Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Spirit 4WD',
 'year': 2012}
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49133%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Saving data for AB49133: {'created_time': 1774722658.31921, 'last_price_update_time': 1774722658.31922, 'auction_closing_time': 1774883755.0}
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB49133') HTTP/1.1" 204 0
2026-03-28 18:30:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:30:58 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 5992 | hits on page: 40
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10464%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Scrape type for HM10464: 0
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ54071%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Scrape type for DJ54071: 0
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW22525%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Scrape type for HW22525: 0
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN54197%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Scrape type for AN54197: 0
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81391%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Scrape type for RB81391: 0
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Scrape type for UY73943: 2
2026-03-28 18:30:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85fce79f-7c9f-5a17-b0c0-17b618758970 with identifier: UY73943
2026-03-28 18:30:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85fce79f-7c9f-5a17-b0c0-17b618758970 with scrape type 2
2026-03-28 18:30:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85fce79f-7c9f-5a17-b0c0-17b618758970 with scrape type 2
2026-03-28 18:30:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85fce79f-7c9f-5a17-b0c0-17b618758970, identifier: UY73943
2026-03-28 18:30:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85fce79f-7c9f-5a17-b0c0-17b618758970 with identifier: UY73943
2026-03-28 18:30:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85fce79f-7c9f-5a17-b0c0-17b618758970 with identifier: UY73943
2026-03-28 18:30:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85fce79f-7c9f-5a17-b0c0-17b618758970 with identifier: UY73943 to the API
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:30:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:55:07Z',
 'fuel_type': 'diesel',
 'id': '85fce79f-7c9f-5a17-b0c0-17b618758970',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY73943',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 253076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Honda CR-V 1.6 DTEC Elegance 2WD',
 'transmission': 'manual',
 'trim': 'Elegance 2WD',
 'year': 2016}
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY73943%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Saving data for UY73943: {'auction_closing_time': 1774886107.0, 'created_time': 1773305845.390094, 'last_price_update_time': 1774722658.951737}
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY73943') HTTP/1.1" 204 0
2026-03-28 18:30:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63268%27 HTTP/1.1" 200 None
2026-03-28 18:30:58 [auto1.de] INFO: Scrape type for GC63268: 0
2026-03-28 18:30:58 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-28 18:30:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN59671%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for TN59671: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB75617%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for JB75617: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB44844%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for DB44844: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09054%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for PC09054: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB40940%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for VB40940: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS06113%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for YS06113: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX34650%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for VX34650: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN58886%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for UN58886: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK39912%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for ZK39912: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN76212%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for JN76212: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ50846%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for FZ50846: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF08287%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for TF08287: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:30:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU29288%27 HTTP/1.1" 200 None
2026-03-28 18:30:59 [auto1.de] INFO: Scrape type for TU29288: 0
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-28 18:30:59 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-28 18:31:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:00 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 5992 | hits on page: 40
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG77275%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Scrape type for AG77275: 0
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM03290%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Scrape type for LM03290: 0
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG37810%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Scrape type for MG37810: 0
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Scrape type for BY58400: 2
2026-03-28 18:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03351b3b-653b-557a-b8f3-5dc54c867ff4 with identifier: BY58400
2026-03-28 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03351b3b-653b-557a-b8f3-5dc54c867ff4 with scrape type 2
2026-03-28 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03351b3b-653b-557a-b8f3-5dc54c867ff4 with scrape type 2
2026-03-28 18:31:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03351b3b-653b-557a-b8f3-5dc54c867ff4, identifier: BY58400
2026-03-28 18:31:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03351b3b-653b-557a-b8f3-5dc54c867ff4 with identifier: BY58400
2026-03-28 18:31:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03351b3b-653b-557a-b8f3-5dc54c867ff4 with identifier: BY58400
2026-03-28 18:31:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03351b3b-653b-557a-b8f3-5dc54c867ff4 with identifier: BY58400 to the API
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:17:57Z',
 'fuel_type': 'diesel',
 'id': '03351b3b-653b-557a-b8f3-5dc54c867ff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY58400',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Cruze',
 'odometer': 201900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-17',
 'seller_name': None,
 'title': 'Chevrolet Cruze 2.0 Diesel LTZ',
 'transmission': 'automatic',
 'trim': 'LTZ',
 'year': 2011}
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY58400%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Saving data for BY58400: {'auction_closing_time': 1774883877.0, 'created_time': 1772543113.978979, 'last_price_update_time': 1774722660.822275}
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY58400') HTTP/1.1" 204 0
2026-03-28 18:31:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41377%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Scrape type for DV41377: 0
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ32425%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Scrape type for DJ32425: 0
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP32495%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Scrape type for BP32495: 0
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-28 18:31:00 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-28 18:31:00 [auto1.de] INFO: Scrape type for ZM52655: 2
2026-03-28 18:31:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f2063fc-582c-5785-8b5d-07618afda648 with identifier: ZM52655
2026-03-28 18:31:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f2063fc-582c-5785-8b5d-07618afda648 with scrape type 2
2026-03-28 18:31:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f2063fc-582c-5785-8b5d-07618afda648 with scrape type 2
2026-03-28 18:31:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f2063fc-582c-5785-8b5d-07618afda648, identifier: ZM52655
2026-03-28 18:31:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f2063fc-582c-5785-8b5d-07618afda648 with identifier: ZM52655
2026-03-28 18:31:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f2063fc-582c-5785-8b5d-07618afda648 with identifier: ZM52655
2026-03-28 18:31:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f2063fc-582c-5785-8b5d-07618afda648 with identifier: ZM52655 to the API
2026-03-28 18:31:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:43:57Z',
 'fuel_type': 'petrol',
 'id': '6f2063fc-582c-5785-8b5d-07618afda648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM52655',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 160522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-02-15',
 'seller_name': None,
 'title': 'Volvo V40 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 1999}
2026-03-28 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM52655%27 HTTP/1.1" 200 None
2026-03-28 18:31:01 [auto1.de] INFO: Saving data for ZM52655: {'auction_closing_time': 1774885437.0, 'created_time': 1774032613.749931, 'last_price_update_time': 1774722661.901311}
2026-03-28 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM52655') HTTP/1.1" 204 0
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Scrape type for DG23161: 2
2026-03-28 18:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434f30db-432a-5581-b21d-950c0a9274e8 with identifier: DG23161
2026-03-28 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434f30db-432a-5581-b21d-950c0a9274e8 with scrape type 2
2026-03-28 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 434f30db-432a-5581-b21d-950c0a9274e8 with scrape type 2
2026-03-28 18:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 434f30db-432a-5581-b21d-950c0a9274e8, identifier: DG23161
2026-03-28 18:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 434f30db-432a-5581-b21d-950c0a9274e8 with identifier: DG23161
2026-03-28 18:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 434f30db-432a-5581-b21d-950c0a9274e8 with identifier: DG23161
2026-03-28 18:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 434f30db-432a-5581-b21d-950c0a9274e8 with identifier: DG23161 to the API
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:33:49Z',
 'fuel_type': 'petrol',
 'id': '434f30db-432a-5581-b21d-950c0a9274e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG23161',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 131636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-12',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG23161%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Saving data for DG23161: {'auction_closing_time': 1774884829.0, 'created_time': 1774522289.120721, 'last_price_update_time': 1774722662.444763}
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG23161') HTTP/1.1" 204 0
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT55268%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Scrape type for HT55268: 0
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB33034%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Scrape type for BB33034: 0
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH84206%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Scrape type for JH84206: 0
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP28928%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Scrape type for GP28928: 0
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB85475%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Scrape type for RB85475: 0
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF35013%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Scrape type for AF35013: 0
2026-03-28 18:31:02 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-28 18:31:02 [auto1.de] INFO: Scrape type for JV22464: 2
2026-03-28 18:31:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with identifier: JV22464
2026-03-28 18:31:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with scrape type 2
2026-03-28 18:31:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with scrape type 2
2026-03-28 18:31:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5, identifier: JV22464
2026-03-28 18:31:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with identifier: JV22464
2026-03-28 18:31:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with identifier: JV22464
2026-03-28 18:31:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab4b5d81-4ba3-5bf9-abae-00e756ff67e5 with identifier: JV22464 to the API
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:29:14Z',
 'fuel_type': 'petrol',
 'id': 'ab4b5d81-4ba3-5bf9-abae-00e756ff67e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV22464',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 192375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2014}
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV22464%27 HTTP/1.1" 200 None
2026-03-28 18:31:03 [auto1.de] INFO: Saving data for JV22464: {'auction_closing_time': 1774884554.0, 'created_time': 1774034432.079096, 'last_price_update_time': 1774722663.071944}
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV22464') HTTP/1.1" 204 0
2026-03-28 18:31:03 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-28 18:31:03 [auto1.de] INFO: Scrape type for GY48177: 2
2026-03-28 18:31:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f937f208-bc48-5c82-9169-f40f67d8c916 with identifier: GY48177
2026-03-28 18:31:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f937f208-bc48-5c82-9169-f40f67d8c916 with scrape type 2
2026-03-28 18:31:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f937f208-bc48-5c82-9169-f40f67d8c916 with scrape type 2
2026-03-28 18:31:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f937f208-bc48-5c82-9169-f40f67d8c916, identifier: GY48177
2026-03-28 18:31:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f937f208-bc48-5c82-9169-f40f67d8c916 with identifier: GY48177
2026-03-28 18:31:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f937f208-bc48-5c82-9169-f40f67d8c916 with identifier: GY48177
2026-03-28 18:31:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f937f208-bc48-5c82-9169-f40f67d8c916 with identifier: GY48177 to the API
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:55:37Z',
 'fuel_type': 'petrol',
 'id': 'f937f208-bc48-5c82-9169-f40f67d8c916',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY48177',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 95858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-13',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Turbo Basis pulse',
 'transmission': 'automatic',
 'trim': 'Basis pulse',
 'year': 2014}
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY48177%27 HTTP/1.1" 200 None
2026-03-28 18:31:03 [auto1.de] INFO: Saving data for GY48177: {'auction_closing_time': 1774886137.0, 'created_time': 1774032248.379102, 'last_price_update_time': 1774722663.690708}
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY48177') HTTP/1.1" 204 0
2026-03-28 18:31:03 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM82116%27 HTTP/1.1" 200 None
2026-03-28 18:31:03 [auto1.de] INFO: Scrape type for XM82116: 0
2026-03-28 18:31:03 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV18867%27 HTTP/1.1" 200 None
2026-03-28 18:31:03 [auto1.de] INFO: Scrape type for SV18867: 0
2026-03-28 18:31:03 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ74678%27 HTTP/1.1" 200 None
2026-03-28 18:31:03 [auto1.de] INFO: Scrape type for SZ74678: 0
2026-03-28 18:31:03 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL47086%27 HTTP/1.1" 200 None
2026-03-28 18:31:03 [auto1.de] INFO: Scrape type for SL47086: 0
2026-03-28 18:31:03 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-28 18:31:03 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ65167%27 HTTP/1.1" 200 None
2026-03-28 18:31:03 [auto1.de] INFO: Scrape type for EJ65167: 0
2026-03-28 18:31:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:04 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 5992 | hits on page: 40
2026-03-28 18:31:04 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-28 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR97371%27 HTTP/1.1" 200 None
2026-03-28 18:31:04 [auto1.de] INFO: Scrape type for JR97371: 0
2026-03-28 18:31:04 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-28 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-28 18:31:04 [auto1.de] INFO: Scrape type for VS79881: 2
2026-03-28 18:31:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with identifier: VS79881
2026-03-28 18:31:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with scrape type 2
2026-03-28 18:31:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with scrape type 2
2026-03-28 18:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d4d0418-77e4-50a9-b503-3ec70eca58e6, identifier: VS79881
2026-03-28 18:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with identifier: VS79881
2026-03-28 18:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with identifier: VS79881
2026-03-28 18:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d4d0418-77e4-50a9-b503-3ec70eca58e6 with identifier: VS79881 to the API
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:59:08Z',
 'fuel_type': 'diesel',
 'id': '5d4d0418-77e4-50a9-b503-3ec70eca58e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS79881',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 306718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-30',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS79881%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Saving data for VS79881: {'auction_closing_time': 1774886348.0, 'created_time': 1774521762.554843, 'last_price_update_time': 1774722665.410728}
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS79881') HTTP/1.1" 204 0
2026-03-28 18:31:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT14864%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Scrape type for JT14864: 0
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM99769%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Scrape type for JM99769: 0
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH65688%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Scrape type for PH65688: 0
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41784%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Scrape type for MF41784: 0
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR81453%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Scrape type for XR81453: 0
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06812%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Scrape type for SC06812: 0
2026-03-28 18:31:05 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Scrape type for RY72669: 2
2026-03-28 18:31:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0fb85a2-a71c-5a84-bdf4-599890367e5f with identifier: RY72669
2026-03-28 18:31:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0fb85a2-a71c-5a84-bdf4-599890367e5f with scrape type 2
2026-03-28 18:31:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0fb85a2-a71c-5a84-bdf4-599890367e5f with scrape type 2
2026-03-28 18:31:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0fb85a2-a71c-5a84-bdf4-599890367e5f, identifier: RY72669
2026-03-28 18:31:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0fb85a2-a71c-5a84-bdf4-599890367e5f with identifier: RY72669
2026-03-28 18:31:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0fb85a2-a71c-5a84-bdf4-599890367e5f with identifier: RY72669
2026-03-28 18:31:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0fb85a2-a71c-5a84-bdf4-599890367e5f with identifier: RY72669 to the API
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:17:37Z',
 'fuel_type': 'diesel',
 'id': 'a0fb85a2-a71c-5a84-bdf4-599890367e5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY72669',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 210688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2015}
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY72669%27 HTTP/1.1" 200 None
2026-03-28 18:31:05 [auto1.de] INFO: Saving data for RY72669: {'auction_closing_time': 1774883857.0, 'created_time': 1773426714.173984, 'last_price_update_time': 1774722665.963042}
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY72669') HTTP/1.1" 204 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY28321%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for MY28321: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK00341%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for FK00341: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT72401%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for LT72401: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX26895%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for MX26895: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS81826%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for CS81826: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE46493%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for LE46493: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ65077%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for LJ65077: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for SB37681: 2
2026-03-28 18:31:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4355646-53fc-5eae-9198-793cb8312dfd with identifier: SB37681
2026-03-28 18:31:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4355646-53fc-5eae-9198-793cb8312dfd with scrape type 2
2026-03-28 18:31:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4355646-53fc-5eae-9198-793cb8312dfd with scrape type 2
2026-03-28 18:31:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4355646-53fc-5eae-9198-793cb8312dfd, identifier: SB37681
2026-03-28 18:31:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4355646-53fc-5eae-9198-793cb8312dfd with identifier: SB37681
2026-03-28 18:31:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4355646-53fc-5eae-9198-793cb8312dfd with identifier: SB37681
2026-03-28 18:31:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4355646-53fc-5eae-9198-793cb8312dfd with identifier: SB37681 to the API
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:31:20Z',
 'fuel_type': 'diesel',
 'id': 'a4355646-53fc-5eae-9198-793cb8312dfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB37681',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 148708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB37681%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Saving data for SB37681: {'auction_closing_time': 1774884680.0, 'created_time': 1774521868.278871, 'last_price_update_time': 1774722666.656198}
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB37681') HTTP/1.1" 204 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ62454%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for HJ62454: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD80009%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for PD80009: 0
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-28 18:31:06 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-28 18:31:06 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-28 18:31:07 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 34 pages/min), scraped 71 items (at 71 items/min)
2026-03-28 18:31:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-28 18:31:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:08 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41663%27 HTTP/1.1" 200 None
2026-03-28 18:31:08 [auto1.de] INFO: Scrape type for SP41663: 0
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN78852%27 HTTP/1.1" 200 None
2026-03-28 18:31:08 [auto1.de] INFO: Scrape type for BN78852: 0
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL48246%27 HTTP/1.1" 200 None
2026-03-28 18:31:08 [auto1.de] INFO: Scrape type for PL48246: 0
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF82631%27 HTTP/1.1" 200 None
2026-03-28 18:31:08 [auto1.de] INFO: Scrape type for EF82631: 0
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS72141%27 HTTP/1.1" 200 None
2026-03-28 18:31:08 [auto1.de] INFO: Scrape type for LS72141: 0
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-28 18:31:08 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM83282%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for CM83282: 0
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ96817%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for BZ96817: 0
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE94001%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for GE94001: 0
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV29491%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for CV29491: 0
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ33462%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for UJ33462: 0
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ40099%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for EJ40099: 0
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52465%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for RS52465: 0
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE78461%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for WE78461: 0
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for GJ72633: 2
2026-03-28 18:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38d2034b-5971-5cc1-a857-48298aecee5c with identifier: GJ72633
2026-03-28 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38d2034b-5971-5cc1-a857-48298aecee5c with scrape type 2
2026-03-28 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38d2034b-5971-5cc1-a857-48298aecee5c with scrape type 2
2026-03-28 18:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38d2034b-5971-5cc1-a857-48298aecee5c, identifier: GJ72633
2026-03-28 18:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38d2034b-5971-5cc1-a857-48298aecee5c with identifier: GJ72633
2026-03-28 18:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38d2034b-5971-5cc1-a857-48298aecee5c with identifier: GJ72633
2026-03-28 18:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38d2034b-5971-5cc1-a857-48298aecee5c with identifier: GJ72633 to the API
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:57Z',
 'fuel_type': 'diesel',
 'id': '38d2034b-5971-5cc1-a857-48298aecee5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ72633',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 286016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72633%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Saving data for GJ72633: {'auction_closing_time': 1774885857.0, 'created_time': 1774521158.073127, 'last_price_update_time': 1774722669.615216}
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ72633') HTTP/1.1" 204 0
2026-03-28 18:31:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-28 18:31:09 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-28 18:31:09 [auto1.de] INFO: Scrape type for BB70854: 2
2026-03-28 18:31:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae2fbc24-becd-59b5-8a83-2a7165984a28 with identifier: BB70854
2026-03-28 18:31:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae2fbc24-becd-59b5-8a83-2a7165984a28 with scrape type 2
2026-03-28 18:31:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae2fbc24-becd-59b5-8a83-2a7165984a28 with scrape type 2
2026-03-28 18:31:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae2fbc24-becd-59b5-8a83-2a7165984a28, identifier: BB70854
2026-03-28 18:31:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae2fbc24-becd-59b5-8a83-2a7165984a28 with identifier: BB70854
2026-03-28 18:31:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae2fbc24-becd-59b5-8a83-2a7165984a28 with identifier: BB70854
2026-03-28 18:31:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae2fbc24-becd-59b5-8a83-2a7165984a28 with identifier: BB70854 to the API
2026-03-28 18:31:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:23:42Z',
 'fuel_type': 'diesel',
 'id': 'ae2fbc24-becd-59b5-8a83-2a7165984a28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB70854',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 273860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-27',
 'seller_name': None,
 'title': 'Volvo XC90 2.4 D5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2006}
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB70854%27 HTTP/1.1" 200 None
2026-03-28 18:31:10 [auto1.de] INFO: Saving data for BB70854: {'auction_closing_time': 1774884222.0, 'created_time': 1773398979.879557, 'last_price_update_time': 1774722670.175342}
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB70854') HTTP/1.1" 204 0
2026-03-28 18:31:10 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW85438%27 HTTP/1.1" 200 None
2026-03-28 18:31:10 [auto1.de] INFO: Scrape type for XW85438: 0
2026-03-28 18:31:10 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-28 18:31:10 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP85116%27 HTTP/1.1" 200 None
2026-03-28 18:31:10 [auto1.de] INFO: Scrape type for VP85116: 0
2026-03-28 18:31:10 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-28 18:31:10 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-28 18:31:10 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-28 18:31:10 [auto1.de] INFO: Scrape type for ZM17001: 1
2026-03-28 18:31:10 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43942%27 HTTP/1.1" 200 None
2026-03-28 18:31:10 [auto1.de] INFO: Scrape type for HA43942: 0
2026-03-28 18:31:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM17001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:11 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ88373%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for AJ88373: 0
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU31630%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for DU31630: 0
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF91285%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for KF91285: 0
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX50182%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for WX50182: 0
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE25361%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for SE25361: 0
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF17432%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for DF17432: 0
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD93100%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for CD93100: 0
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for WA68072: 2
2026-03-28 18:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06692bba-450b-5ecf-900c-b803d00518f9 with identifier: WA68072
2026-03-28 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06692bba-450b-5ecf-900c-b803d00518f9 with scrape type 2
2026-03-28 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06692bba-450b-5ecf-900c-b803d00518f9 with scrape type 2
2026-03-28 18:31:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06692bba-450b-5ecf-900c-b803d00518f9, identifier: WA68072
2026-03-28 18:31:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06692bba-450b-5ecf-900c-b803d00518f9 with identifier: WA68072
2026-03-28 18:31:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06692bba-450b-5ecf-900c-b803d00518f9 with identifier: WA68072
2026-03-28 18:31:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06692bba-450b-5ecf-900c-b803d00518f9 with identifier: WA68072 to the API
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:09:30Z',
 'fuel_type': 'diesel',
 'id': '06692bba-450b-5ecf-900c-b803d00518f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA68072',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 261807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68072%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Saving data for WA68072: {'auction_closing_time': 1774883370.0, 'created_time': 1773426767.144878, 'last_price_update_time': 1774722671.663776}
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA68072') HTTP/1.1" 204 0
2026-03-28 18:31:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN46705%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for EN46705: 0
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-28 18:31:11 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-28 18:31:11 [auto1.de] INFO: Scrape type for LC33794: 2
2026-03-28 18:31:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with identifier: LC33794
2026-03-28 18:31:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with scrape type 2
2026-03-28 18:31:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with scrape type 2
2026-03-28 18:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0, identifier: LC33794
2026-03-28 18:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with identifier: LC33794
2026-03-28 18:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with identifier: LC33794
2026-03-28 18:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0 with identifier: LC33794 to the API
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:05:03Z',
 'fuel_type': 'petrol',
 'id': '3019c8e3-72c0-567d-8b78-fd6fbf1b1ea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC33794',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 154230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-14',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Dream Team 2WD',
 'transmission': 'manual',
 'trim': 'Dream Team 2WD',
 'year': 2018}
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33794%27 HTTP/1.1" 200 None
2026-03-28 18:31:12 [auto1.de] INFO: Saving data for LC33794: {'auction_closing_time': 1774883103.0, 'created_time': 1774522508.369997, 'last_price_update_time': 1774722672.395531}
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC33794') HTTP/1.1" 204 0
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV32404%27 HTTP/1.1" 200 None
2026-03-28 18:31:12 [auto1.de] INFO: Scrape type for JV32404: 0
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55209%27 HTTP/1.1" 200 None
2026-03-28 18:31:12 [auto1.de] INFO: Scrape type for LV55209: 0
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-28 18:31:12 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-28 18:31:12 [auto1.de] INFO: Scrape type for HP02844: 2
2026-03-28 18:31:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e553ccfd-61d0-5d44-88cc-e20964938d6c with identifier: HP02844
2026-03-28 18:31:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e553ccfd-61d0-5d44-88cc-e20964938d6c with scrape type 2
2026-03-28 18:31:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e553ccfd-61d0-5d44-88cc-e20964938d6c with scrape type 2
2026-03-28 18:31:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e553ccfd-61d0-5d44-88cc-e20964938d6c, identifier: HP02844
2026-03-28 18:31:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e553ccfd-61d0-5d44-88cc-e20964938d6c with identifier: HP02844
2026-03-28 18:31:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e553ccfd-61d0-5d44-88cc-e20964938d6c with identifier: HP02844
2026-03-28 18:31:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e553ccfd-61d0-5d44-88cc-e20964938d6c with identifier: HP02844 to the API
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:23:47Z',
 'fuel_type': 'petrol',
 'id': 'e553ccfd-61d0-5d44-88cc-e20964938d6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP02844',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 58472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-13',
 'seller_name': None,
 'title': 'BMW 4er M4 Competition',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2021}
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP02844%27 HTTP/1.1" 200 None
2026-03-28 18:31:12 [auto1.de] INFO: Saving data for HP02844: {'auction_closing_time': 1774884227.0, 'created_time': 1774349441.735659, 'last_price_update_time': 1774722672.905976}
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP02844') HTTP/1.1" 204 0
2026-03-28 18:31:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY04435%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for JY04435: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD63050%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for RD63050: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32254%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for TA32254: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28655%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for RM28655: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK33509%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for FK33509: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX73478%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for WX73478: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH40869%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for DH40869: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC35382%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for KC35382: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-28 18:31:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:13 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT17427%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for WT17427: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB57303%27 HTTP/1.1" 200 None
2026-03-28 18:31:13 [auto1.de] INFO: Scrape type for LB57303: 0
2026-03-28 18:31:13 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG70910%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for WG70910: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK29715%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for CK29715: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX86501%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for DX86501: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB88794%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for TB88794: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH21308%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for JH21308: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY38504%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for VY38504: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB54670%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for BB54670: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA69574%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for SA69574: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for XY94981: 2
2026-03-28 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with identifier: XY94981
2026-03-28 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with scrape type 2
2026-03-28 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with scrape type 2
2026-03-28 18:31:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7, identifier: XY94981
2026-03-28 18:31:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with identifier: XY94981
2026-03-28 18:31:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with identifier: XY94981
2026-03-28 18:31:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2e085d5-3bf4-5f8e-8239-88d6fec3b2e7 with identifier: XY94981 to the API
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:01:59Z',
 'fuel_type': 'petrol',
 'id': 'd2e085d5-3bf4-5f8e-8239-88d6fec3b2e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY94981',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 87931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY94981%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Saving data for XY94981: {'auction_closing_time': 1774882919.0, 'created_time': 1773302159.890707, 'last_price_update_time': 1774722674.567228}
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY94981') HTTP/1.1" 204 0
2026-03-28 18:31:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA01437%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for FA01437: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ38333%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for YZ38333: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB25597%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for DB25597: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH65606%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for JH65606: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR66726%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for DR66726: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG14507%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for GG14507: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG84958%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for VG84958: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL40040%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for WL40040: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH25554%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for EH25554: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT97344%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for JT97344: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG00954%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for WG00954: 0
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-28 18:31:14 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK88723%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [auto1.de] INFO: Scrape type for YK88723: 0
2026-03-28 18:31:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM17001> (referer: https://www.auto1.com/v1/car-details-view/ZM17001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b74b62a6-8a41-539c-870c-d453d75145b9 with identifier: ZM17001
2026-03-28 18:31:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b74b62a6-8a41-539c-870c-d453d75145b9 with scrape type 1
2026-03-28 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b74b62a6-8a41-539c-870c-d453d75145b9
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_0265677cef4cba1e4d0e6624a1e1d5fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_0265677cef4cba1e4d0e6624a1e1d5fb.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_8b2f1533df6b388b7093e1b58238e3ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_8b2f1533df6b388b7093e1b58238e3ae.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_ca0661a24005d056ba5c9e4ea3fbe44c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_ca0661a24005d056ba5c9e4ea3fbe44c.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_cca22fd7f80e260e4f14204752e429d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_cca22fd7f80e260e4f14204752e429d4.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_6352b0aeeaed9cbe1505a3fcbb884ebe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_6352b0aeeaed9cbe1505a3fcbb884ebe.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_50a79800257190a05024b7667ff83301.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_50a79800257190a05024b7667ff83301.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_06aa1b2839ba2c8ed1dc253924459ad0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_06aa1b2839ba2c8ed1dc253924459ad0.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_465611e893505ac82738b06f803d6e5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_465611e893505ac82738b06f803d6e5a.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_e3f9dcd9dd988e6ec59bd7be13007366.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_e3f9dcd9dd988e6ec59bd7be13007366.jpg already downloaded
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fe4%252F5ce45f620ce9eb8c7368ec2f6292e7e9%252Fpa%252FZM17001_d69d733e376f54154239c38542d8ddf2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_d69d733e376f54154239c38542d8ddf2.jpg already downloaded
2026-03-28 18:31:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b74b62a6-8a41-539c-870c-d453d75145b9, identifier: ZM17001
2026-03-28 18:31:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b74b62a6-8a41-539c-870c-d453d75145b9 with identifier: ZM17001
2026-03-28 18:31:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b74b62a6-8a41-539c-870c-d453d75145b9 with identifier: ZM17001
2026-03-28 18:31:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b74b62a6-8a41-539c-870c-d453d75145b9 with identifier: ZM17001 to the API
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZM17001>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:42:34Z',
 'fuel_type': 'petrol',
 'id': 'b74b62a6-8a41-539c-870c-d453d75145b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM17001',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 108063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_0265677cef4cba1e4d0e6624a1e1d5fb.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_8b2f1533df6b388b7093e1b58238e3ae.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_ca0661a24005d056ba5c9e4ea3fbe44c.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_cca22fd7f80e260e4f14204752e429d4.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_6352b0aeeaed9cbe1505a3fcbb884ebe.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_50a79800257190a05024b7667ff83301.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_06aa1b2839ba2c8ed1dc253924459ad0.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_465611e893505ac82738b06f803d6e5a.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_e3f9dcd9dd988e6ec59bd7be13007366.jpg',
                'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_d69d733e376f54154239c38542d8ddf2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3039713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_0265677cef4cba1e4d0e6624a1e1d5fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_8b2f1533df6b388b7093e1b58238e3ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_ca0661a24005d056ba5c9e4ea3fbe44c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3278690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_cca22fd7f80e260e4f14204752e429d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94438,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_6352b0aeeaed9cbe1505a3fcbb884ebe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2745222,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_50a79800257190a05024b7667ff83301.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2804977,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_06aa1b2839ba2c8ed1dc253924459ad0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_465611e893505ac82738b06f803d6e5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_e3f9dcd9dd988e6ec59bd7be13007366.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b74b62a6-8a41-539c-870c-d453d75145b9/b74b62a6-8a41-539c-870c-d453d75145b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/e4/5ce45f620ce9eb8c7368ec2f6292e7e9/pa/ZM17001_d69d733e376f54154239c38542d8ddf2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TFSI GTI "Performance" BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI "Performance" BlueMotion',
 'year': 2014}
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM17001%27 HTTP/1.1" 200 None
2026-03-28 18:31:15 [auto1.de] INFO: Saving data for ZM17001: {'created_time': 1774722675.569035, 'last_price_update_time': 1774722675.569046, 'auction_closing_time': 1774885354.0}
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM17001') HTTP/1.1" 204 0
2026-03-28 18:31:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:16 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:16 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-28 18:31:16 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-28 18:31:16 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF89419%27 HTTP/1.1" 200 None
2026-03-28 18:31:16 [auto1.de] INFO: Scrape type for TF89419: 0
2026-03-28 18:31:16 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54596%27 HTTP/1.1" 200 None
2026-03-28 18:31:16 [auto1.de] INFO: Scrape type for HJ54596: 0
2026-03-28 18:31:16 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-28 18:31:16 [auto1.de] INFO: Scrape type for MR23018: 2
2026-03-28 18:31:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20e4d939-4e07-5d3d-b5e9-7460306fa189 with identifier: MR23018
2026-03-28 18:31:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20e4d939-4e07-5d3d-b5e9-7460306fa189 with scrape type 2
2026-03-28 18:31:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20e4d939-4e07-5d3d-b5e9-7460306fa189 with scrape type 2
2026-03-28 18:31:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20e4d939-4e07-5d3d-b5e9-7460306fa189, identifier: MR23018
2026-03-28 18:31:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20e4d939-4e07-5d3d-b5e9-7460306fa189 with identifier: MR23018
2026-03-28 18:31:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20e4d939-4e07-5d3d-b5e9-7460306fa189 with identifier: MR23018
2026-03-28 18:31:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20e4d939-4e07-5d3d-b5e9-7460306fa189 with identifier: MR23018 to the API
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:02:56Z',
 'fuel_type': 'diesel',
 'id': '20e4d939-4e07-5d3d-b5e9-7460306fa189',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR23018',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 254114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR23018%27 HTTP/1.1" 200 None
2026-03-28 18:31:16 [auto1.de] INFO: Saving data for MR23018: {'auction_closing_time': 1774882976.0, 'created_time': 1773307857.020933, 'last_price_update_time': 1774722676.994691}
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR23018') HTTP/1.1" 204 0
2026-03-28 18:31:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP18010%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for HP18010: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF15442%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for LF15442: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP87000%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for HP87000: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK99321%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for SK99321: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35615%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for HZ35615: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ11294%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for HJ11294: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER42295%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for ER42295: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for SL53901: 2
2026-03-28 18:31:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a8432f3-4b26-593b-b06f-581645d131fe with identifier: SL53901
2026-03-28 18:31:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a8432f3-4b26-593b-b06f-581645d131fe with scrape type 2
2026-03-28 18:31:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a8432f3-4b26-593b-b06f-581645d131fe with scrape type 2
2026-03-28 18:31:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a8432f3-4b26-593b-b06f-581645d131fe, identifier: SL53901
2026-03-28 18:31:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a8432f3-4b26-593b-b06f-581645d131fe with identifier: SL53901
2026-03-28 18:31:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a8432f3-4b26-593b-b06f-581645d131fe with identifier: SL53901
2026-03-28 18:31:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a8432f3-4b26-593b-b06f-581645d131fe with identifier: SL53901 to the API
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:16:28Z',
 'fuel_type': 'diesel',
 'id': '3a8432f3-4b26-593b-b06f-581645d131fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL53901',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 32749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-05',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 110 CDI Worker Plus',
 'transmission': 'manual',
 'trim': 'Worker Plus',
 'year': 2022}
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL53901%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Saving data for SL53901: {'auction_closing_time': 1774883788.0, 'created_time': 1774636254.105925, 'last_price_update_time': 1774722677.595571}
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL53901') HTTP/1.1" 204 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC59357%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for DC59357: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW94281%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for DW94281: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD47640%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for VD47640: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV26569%27 HTTP/1.1" 200 None
2026-03-28 18:31:17 [auto1.de] INFO: Scrape type for UV26569: 0
2026-03-28 18:31:17 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-28 18:31:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:19 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD15809%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for LD15809: 0
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for KV36004: 1
2026-03-28 18:31:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH75068%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for TH75068: 0
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ25562%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for JZ25562: 0
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX84018%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for EX84018: 0
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ96778%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for JZ96778: 0
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL93555%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for AL93555: 0
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX95086%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for SX95086: 0
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE98572%27 HTTP/1.1" 200 None
2026-03-28 18:31:19 [auto1.de] INFO: Scrape type for KE98572: 0
2026-03-28 18:31:19 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-28 18:31:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF74811%27 HTTP/1.1" 200 None
2026-03-28 18:31:20 [auto1.de] INFO: Scrape type for ZF74811: 0
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09519%27 HTTP/1.1" 200 None
2026-03-28 18:31:20 [auto1.de] INFO: Scrape type for WE09519: 0
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE96933%27 HTTP/1.1" 200 None
2026-03-28 18:31:20 [auto1.de] INFO: Scrape type for HE96933: 0
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-28 18:31:20 [auto1.de] INFO: Scrape type for CF84548: 2
2026-03-28 18:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with identifier: CF84548
2026-03-28 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with scrape type 2
2026-03-28 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with scrape type 2
2026-03-28 18:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5, identifier: CF84548
2026-03-28 18:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with identifier: CF84548
2026-03-28 18:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with identifier: CF84548
2026-03-28 18:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cb5ca63-2080-5f02-9c0c-d701d0603bb5 with identifier: CF84548 to the API
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:12:45Z',
 'fuel_type': 'petrol',
 'id': '2cb5ca63-2080-5f02-9c0c-d701d0603bb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF84548',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 239995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-28',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Young',
 'transmission': 'manual',
 'trim': 'Young',
 'year': 2009}
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF84548%27 HTTP/1.1" 200 None
2026-03-28 18:31:20 [auto1.de] INFO: Saving data for CF84548: {'auction_closing_time': 1774883565.0, 'created_time': 1774031483.038633, 'last_price_update_time': 1774722680.521096}
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF84548') HTTP/1.1" 204 0
2026-03-28 18:31:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD70113%27 HTTP/1.1" 200 None
2026-03-28 18:31:20 [auto1.de] INFO: Scrape type for JD70113: 0
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-28 18:31:20 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-28 18:31:20 [auto1.de] INFO: Scrape type for TD06456: 2
2026-03-28 18:31:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9315ac04-4684-569c-b4fa-4b70ff8f16cb with identifier: TD06456
2026-03-28 18:31:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9315ac04-4684-569c-b4fa-4b70ff8f16cb with scrape type 2
2026-03-28 18:31:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9315ac04-4684-569c-b4fa-4b70ff8f16cb with scrape type 2
2026-03-28 18:31:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9315ac04-4684-569c-b4fa-4b70ff8f16cb, identifier: TD06456
2026-03-28 18:31:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9315ac04-4684-569c-b4fa-4b70ff8f16cb with identifier: TD06456
2026-03-28 18:31:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9315ac04-4684-569c-b4fa-4b70ff8f16cb with identifier: TD06456
2026-03-28 18:31:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9315ac04-4684-569c-b4fa-4b70ff8f16cb with identifier: TD06456 to the API
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:23:26Z',
 'fuel_type': 'diesel',
 'id': '9315ac04-4684-569c-b4fa-4b70ff8f16cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD06456',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 138299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-15',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2017}
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD06456%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Saving data for TD06456: {'auction_closing_time': 1774884206.0, 'created_time': 1774349175.336749, 'last_price_update_time': 1774722681.10023}
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD06456') HTTP/1.1" 204 0
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Scrape type for XT71149: 2
2026-03-28 18:31:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with identifier: XT71149
2026-03-28 18:31:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with scrape type 2
2026-03-28 18:31:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with scrape type 2
2026-03-28 18:31:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4, identifier: XT71149
2026-03-28 18:31:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with identifier: XT71149
2026-03-28 18:31:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with identifier: XT71149
2026-03-28 18:31:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4 with identifier: XT71149 to the API
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:35:35Z',
 'fuel_type': 'diesel',
 'id': '3a6e5ce4-fc6e-55a5-afcc-a5bdee5744a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT71149',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 210635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-31',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT71149%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Saving data for XT71149: {'auction_closing_time': 1774884935.0, 'created_time': 1773466882.38484, 'last_price_update_time': 1774722681.538822}
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT71149') HTTP/1.1" 204 0
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU38157%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Scrape type for NU38157: 0
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS14523%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Scrape type for NS14523: 0
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG73044%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Scrape type for DG73044: 0
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB72988%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Scrape type for AB72988: 0
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV77194%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Scrape type for JV77194: 0
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26589%27 HTTP/1.1" 200 None
2026-03-28 18:31:21 [auto1.de] INFO: Scrape type for XN26589: 0
2026-03-28 18:31:21 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-28 18:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV36004/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:22 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ53831%27 HTTP/1.1" 200 None
2026-03-28 18:31:22 [auto1.de] INFO: Scrape type for LJ53831: 0
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31495%27 HTTP/1.1" 200 None
2026-03-28 18:31:22 [auto1.de] INFO: Scrape type for BA31495: 0
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11203%27 HTTP/1.1" 200 None
2026-03-28 18:31:22 [auto1.de] INFO: Scrape type for UL11203: 0
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: US43373
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30949%27 HTTP/1.1" 200 None
2026-03-28 18:31:22 [auto1.de] INFO: Scrape type for ZL30949: 0
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE93045%27 HTTP/1.1" 200 None
2026-03-28 18:31:22 [auto1.de] INFO: Scrape type for AE93045: 0
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82608%27 HTTP/1.1" 200 None
2026-03-28 18:31:22 [auto1.de] INFO: Scrape type for SA82608: 0
2026-03-28 18:31:22 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-28 18:31:22 [auto1.de] INFO: Scrape type for WG96363: 2
2026-03-28 18:31:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with identifier: WG96363
2026-03-28 18:31:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with scrape type 2
2026-03-28 18:31:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with scrape type 2
2026-03-28 18:31:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2049c80d-8e00-5e96-ae1f-ad568d2d9583, identifier: WG96363
2026-03-28 18:31:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with identifier: WG96363
2026-03-28 18:31:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with identifier: WG96363
2026-03-28 18:31:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2049c80d-8e00-5e96-ae1f-ad568d2d9583 with identifier: WG96363 to the API
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:01:25Z',
 'fuel_type': 'petrol',
 'id': '2049c80d-8e00-5e96-ae1f-ad568d2d9583',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG96363',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 304199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-08',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2007}
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG96363%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Saving data for WG96363: {'auction_closing_time': 1774882885.0, 'created_time': 1774522499.680884, 'last_price_update_time': 1774722683.049183}
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG96363') HTTP/1.1" 204 0
2026-03-28 18:31:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ78567%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for BZ78567: 0
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC62608%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for ZC62608: 0
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS52652%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for PS52652: 0
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP99772%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for CP99772: 0
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU77879%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for MU77879: 0
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for VJ44121: 2
2026-03-28 18:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 465d821b-8521-53ac-abd8-97b7f86f927e with identifier: VJ44121
2026-03-28 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 465d821b-8521-53ac-abd8-97b7f86f927e with scrape type 2
2026-03-28 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 465d821b-8521-53ac-abd8-97b7f86f927e with scrape type 2
2026-03-28 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 465d821b-8521-53ac-abd8-97b7f86f927e, identifier: VJ44121
2026-03-28 18:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 465d821b-8521-53ac-abd8-97b7f86f927e with identifier: VJ44121
2026-03-28 18:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 465d821b-8521-53ac-abd8-97b7f86f927e with identifier: VJ44121
2026-03-28 18:31:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 465d821b-8521-53ac-abd8-97b7f86f927e with identifier: VJ44121 to the API
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:17:18Z',
 'fuel_type': 'diesel',
 'id': '465d821b-8521-53ac-abd8-97b7f86f927e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ44121',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 216972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-28',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ44121%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Saving data for VJ44121: {'auction_closing_time': 1774883838.0, 'created_time': 1774521687.857479, 'last_price_update_time': 1774722683.703174}
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ44121') HTTP/1.1" 204 0
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY16661%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for SY16661: 0
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: FP11362
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77262%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for DW77262: 0
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-28 18:31:23 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-28 18:31:23 [auto1.de] INFO: Scrape type for PW56805: 2
2026-03-28 18:31:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caff4273-ad1e-5925-b420-08df34cd9682 with identifier: PW56805
2026-03-28 18:31:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caff4273-ad1e-5925-b420-08df34cd9682 with scrape type 2
2026-03-28 18:31:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caff4273-ad1e-5925-b420-08df34cd9682 with scrape type 2
2026-03-28 18:31:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caff4273-ad1e-5925-b420-08df34cd9682, identifier: PW56805
2026-03-28 18:31:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caff4273-ad1e-5925-b420-08df34cd9682 with identifier: PW56805
2026-03-28 18:31:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caff4273-ad1e-5925-b420-08df34cd9682 with identifier: PW56805
2026-03-28 18:31:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caff4273-ad1e-5925-b420-08df34cd9682 with identifier: PW56805 to the API
2026-03-28 18:31:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:29:35Z',
 'fuel_type': 'diesel',
 'id': 'caff4273-ad1e-5925-b420-08df34cd9682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW56805',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 149304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW56805%27 HTTP/1.1" 200 None
2026-03-28 18:31:24 [auto1.de] INFO: Saving data for PW56805: {'auction_closing_time': 1774884575.0, 'created_time': 1773660454.240943, 'last_price_update_time': 1774722684.282658}
2026-03-28 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW56805') HTTP/1.1" 204 0
2026-03-28 18:31:24 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-28 18:31:24 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-28 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN95277%27 HTTP/1.1" 200 None
2026-03-28 18:31:24 [auto1.de] INFO: Scrape type for VN95277: 0
2026-03-28 18:31:24 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-28 18:31:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZL07582/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV36004> (referer: https://www.auto1.com/v1/car-details-view/KV36004/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with identifier: KV36004
2026-03-28 18:31:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with scrape type 1
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_29ed7cb537ce0f4671965134d5a6d414.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_29ed7cb537ce0f4671965134d5a6d414.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_d36d35fe788dd3dccf0a68fc972e0231.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_d36d35fe788dd3dccf0a68fc972e0231.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_4a7c4808afef2dc878ba781cb4a7a9a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_4a7c4808afef2dc878ba781cb4a7a9a4.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_cbc0299a558fa1f3f4624bf5ff81b2d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_cbc0299a558fa1f3f4624bf5ff81b2d7.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_ac80ac914bef899b218a877ab2c77ffd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_ac80ac914bef899b218a877ab2c77ffd.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_d3adb936c850cb319859b31f82066c90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_d3adb936c850cb319859b31f82066c90.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_2d5ae59c017b2ab77a23f807caad9296.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_2d5ae59c017b2ab77a23f807caad9296.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_980c8b5c8a1056d8a95631cc668dbb12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_980c8b5c8a1056d8a95631cc668dbb12.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_47c81660911940dad4714e487c090a5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_47c81660911940dad4714e487c090a5c.jpg already downloaded
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Fe0%252F65e04b83e8cc756fcf7a7e812d9d40cb%252Fpa%252FKV36004_a7a403211c50919eaf97c2559280e732.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_a7a403211c50919eaf97c2559280e732.jpg already downloaded
2026-03-28 18:31:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d, identifier: KV36004
2026-03-28 18:31:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with identifier: KV36004
2026-03-28 18:31:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with identifier: KV36004
2026-03-28 18:31:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d with identifier: KV36004 to the API
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV36004>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:05:27Z',
 'fuel_type': 'diesel',
 'id': '1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV36004',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 270105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_29ed7cb537ce0f4671965134d5a6d414.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_d36d35fe788dd3dccf0a68fc972e0231.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_4a7c4808afef2dc878ba781cb4a7a9a4.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_cbc0299a558fa1f3f4624bf5ff81b2d7.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_ac80ac914bef899b218a877ab2c77ffd.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_d3adb936c850cb319859b31f82066c90.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_2d5ae59c017b2ab77a23f807caad9296.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_980c8b5c8a1056d8a95631cc668dbb12.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_47c81660911940dad4714e487c090a5c.jpg',
                'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_a7a403211c50919eaf97c2559280e732.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_29ed7cb537ce0f4671965134d5a6d414.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2757127,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_d36d35fe788dd3dccf0a68fc972e0231.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3019723,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_4a7c4808afef2dc878ba781cb4a7a9a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2844993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_cbc0299a558fa1f3f4624bf5ff81b2d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_ac80ac914bef899b218a877ab2c77ffd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_d3adb936c850cb319859b31f82066c90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_2d5ae59c017b2ab77a23f807caad9296.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_980c8b5c8a1056d8a95631cc668dbb12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64702,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_47c81660911940dad4714e487c090a5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d/1eb9fcb7-16c4-5a20-9dce-4efa80b7b63d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/e0/65e04b83e8cc756fcf7a7e812d9d40cb/pa/KV36004_a7a403211c50919eaf97c2559280e732.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV36004%27 HTTP/1.1" 200 None
2026-03-28 18:31:25 [auto1.de] INFO: Saving data for KV36004: {'created_time': 1774722685.968977, 'last_price_update_time': 1774722685.96899, 'auction_closing_time': 1774883127.0}
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV36004') HTTP/1.1" 204 0
2026-03-28 18:31:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZL07582> (referer: https://www.auto1.com/v1/car-details-view/ZL07582/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:25 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:25 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-28 18:31:25 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for FZ49091: 2
2026-03-28 18:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with identifier: FZ49091
2026-03-28 18:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with scrape type 2
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with scrape type 2
2026-03-28 18:31:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793, identifier: FZ49091
2026-03-28 18:31:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with identifier: FZ49091
2026-03-28 18:31:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with identifier: FZ49091
2026-03-28 18:31:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793 with identifier: FZ49091 to the API
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:24:49Z',
 'fuel_type': 'diesel',
 'id': '6cabb20e-23c4-5f63-9fe8-dc5ecdf9b793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ49091',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 244217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-24',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.9 TDI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ49091%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Saving data for FZ49091: {'auction_closing_time': 1774884289.0, 'created_time': 1773467880.312678, 'last_price_update_time': 1774722686.448061}
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ49091') HTTP/1.1" 204 0
2026-03-28 18:31:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB91859%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for XB91859: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF62239%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for GF62239: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL81757%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for UL81757: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01818%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for HL01818: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV55429%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for BV55429: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33073%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for EC33073: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL73218%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for EL73218: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV61627%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for HV61627: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57461%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for VJ57461: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW06761%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for ZW06761: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC13487%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for XC13487: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL05117%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for JL05117: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB43733%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for KB43733: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ92098%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for AZ92098: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ14861%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for AZ14861: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU22691%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for LU22691: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP14233%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for JP14233: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS23837%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for KS23837: 0
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-28 18:31:26 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA19207%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [auto1.de] INFO: Scrape type for GA19207: 0
2026-03-28 18:31:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with identifier: ZL07582
2026-03-28 18:31:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with scrape type 1
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43ae2915-fc0e-539c-96a8-52ddba92b5d4
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_0826b89d87854961e993db4e56a33645.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_0826b89d87854961e993db4e56a33645.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_008afae7263742f1bd447155dbb0fc6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_008afae7263742f1bd447155dbb0fc6d.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_447fbd692257ffd5a9060f7c369baccd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_447fbd692257ffd5a9060f7c369baccd.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_6be1b964b487018159e1d4549ad9fb7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_6be1b964b487018159e1d4549ad9fb7b.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_ff4fe9b495a42a301170246fda8ddc7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_ff4fe9b495a42a301170246fda8ddc7a.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_2440624e81c62ada9d07bf39b254d1b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_2440624e81c62ada9d07bf39b254d1b4.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_374ebba03bc4a24939b0696f21c97fa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_374ebba03bc4a24939b0696f21c97fa2.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_a70ca131f9fdbf4bec151b4bde7565de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_a70ca131f9fdbf4bec151b4bde7565de.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_ed99caabd92d7a99ed730aa5dc7554db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_ed99caabd92d7a99ed730aa5dc7554db.jpg already downloaded
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F8c%252F258c4178c36d5a3db783abd68dfc471e%252Fpa%252FZL07582_fb555d0e73c34053702cf9e848eed906.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:31:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_fb555d0e73c34053702cf9e848eed906.jpg already downloaded
2026-03-28 18:31:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43ae2915-fc0e-539c-96a8-52ddba92b5d4, identifier: ZL07582
2026-03-28 18:31:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with identifier: ZL07582
2026-03-28 18:31:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with identifier: ZL07582
2026-03-28 18:31:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43ae2915-fc0e-539c-96a8-52ddba92b5d4 with identifier: ZL07582 to the API
2026-03-28 18:31:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZL07582>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:43:55Z',
 'fuel_type': 'diesel',
 'id': '43ae2915-fc0e-539c-96a8-52ddba92b5d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL07582',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'BMW',
 'model': '5er',
 'odometer': 73351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_0826b89d87854961e993db4e56a33645.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_008afae7263742f1bd447155dbb0fc6d.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_447fbd692257ffd5a9060f7c369baccd.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_6be1b964b487018159e1d4549ad9fb7b.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_ff4fe9b495a42a301170246fda8ddc7a.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_2440624e81c62ada9d07bf39b254d1b4.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_374ebba03bc4a24939b0696f21c97fa2.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_a70ca131f9fdbf4bec151b4bde7565de.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_ed99caabd92d7a99ed730aa5dc7554db.jpg',
                'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_fb555d0e73c34053702cf9e848eed906.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_0826b89d87854961e993db4e56a33645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_008afae7263742f1bd447155dbb0fc6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_447fbd692257ffd5a9060f7c369baccd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_6be1b964b487018159e1d4549ad9fb7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_ff4fe9b495a42a301170246fda8ddc7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_2440624e81c62ada9d07bf39b254d1b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_374ebba03bc4a24939b0696f21c97fa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_a70ca131f9fdbf4bec151b4bde7565de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73658,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_ed99caabd92d7a99ed730aa5dc7554db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43ae2915-fc0e-539c-96a8-52ddba92b5d4/43ae2915-fc0e-539c-96a8-52ddba92b5d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67985,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/8c/258c4178c36d5a3db783abd68dfc471e/pa/ZL07582_fb555d0e73c34053702cf9e848eed906.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL07582%27 HTTP/1.1" 200 None
2026-03-28 18:31:27 [auto1.de] INFO: Saving data for ZL07582: {'created_time': 1774722687.43065, 'last_price_update_time': 1774722687.430662, 'auction_closing_time': 1774885435.0}
2026-03-28 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL07582') HTTP/1.1" 204 0
2026-03-28 18:31:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:28 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR29385%27 HTTP/1.1" 200 None
2026-03-28 18:31:28 [auto1.de] INFO: Scrape type for CR29385: 0
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF53882%27 HTTP/1.1" 200 None
2026-03-28 18:31:28 [auto1.de] INFO: Scrape type for HF53882: 0
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS89253%27 HTTP/1.1" 200 None
2026-03-28 18:31:28 [auto1.de] INFO: Scrape type for SS89253: 0
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN72573%27 HTTP/1.1" 200 None
2026-03-28 18:31:28 [auto1.de] INFO: Scrape type for WN72573: 0
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA77532%27 HTTP/1.1" 200 None
2026-03-28 18:31:28 [auto1.de] INFO: Scrape type for GA77532: 0
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV14674%27 HTTP/1.1" 200 None
2026-03-28 18:31:28 [auto1.de] INFO: Scrape type for HV14674: 0
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE42693%27 HTTP/1.1" 200 None
2026-03-28 18:31:28 [auto1.de] INFO: Scrape type for AE42693: 0
2026-03-28 18:31:28 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-28 18:31:28 [auto1.de] INFO: Scrape type for DN26053: 2
2026-03-28 18:31:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8c1afa4-a631-5da0-9597-470271a17205 with identifier: DN26053
2026-03-28 18:31:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8c1afa4-a631-5da0-9597-470271a17205 with scrape type 2
2026-03-28 18:31:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8c1afa4-a631-5da0-9597-470271a17205 with scrape type 2
2026-03-28 18:31:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8c1afa4-a631-5da0-9597-470271a17205, identifier: DN26053
2026-03-28 18:31:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8c1afa4-a631-5da0-9597-470271a17205 with identifier: DN26053
2026-03-28 18:31:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8c1afa4-a631-5da0-9597-470271a17205 with identifier: DN26053
2026-03-28 18:31:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8c1afa4-a631-5da0-9597-470271a17205 with identifier: DN26053 to the API
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:58:07Z',
 'fuel_type': 'petrol',
 'id': 'd8c1afa4-a631-5da0-9597-470271a17205',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN26053',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 92401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2008}
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN26053%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Saving data for DN26053: {'auction_closing_time': 1774886287.0, 'created_time': 1774521651.697173, 'last_price_update_time': 1774722689.109915}
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN26053') HTTP/1.1" 204 0
2026-03-28 18:31:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for PC60624: 2
2026-03-28 18:31:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446aeec3-53df-5223-9dae-8eab800064e4 with identifier: PC60624
2026-03-28 18:31:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446aeec3-53df-5223-9dae-8eab800064e4 with scrape type 2
2026-03-28 18:31:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 446aeec3-53df-5223-9dae-8eab800064e4 with scrape type 2
2026-03-28 18:31:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 446aeec3-53df-5223-9dae-8eab800064e4, identifier: PC60624
2026-03-28 18:31:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 446aeec3-53df-5223-9dae-8eab800064e4 with identifier: PC60624
2026-03-28 18:31:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 446aeec3-53df-5223-9dae-8eab800064e4 with identifier: PC60624
2026-03-28 18:31:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 446aeec3-53df-5223-9dae-8eab800064e4 with identifier: PC60624 to the API
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:13:22Z',
 'fuel_type': 'petrol',
 'id': '446aeec3-53df-5223-9dae-8eab800064e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC60624',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 70196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-21',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2011}
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60624%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Saving data for PC60624: {'auction_closing_time': 1774883602.0, 'created_time': 1774118761.395545, 'last_price_update_time': 1774722689.709484}
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC60624') HTTP/1.1" 204 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ46216%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for NJ46216: 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH34905%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for UH34905: 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH16310%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for KH16310: 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE72170%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for KE72170: 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN13363%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for AN13363: 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB62953%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for VB62953: 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48624%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for WS48624: 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91854%27 HTTP/1.1" 200 None
2026-03-28 18:31:29 [auto1.de] INFO: Scrape type for LC91854: 0
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-28 18:31:29 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-28 18:31:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:30 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:30 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-28 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY85938%27 HTTP/1.1" 200 None
2026-03-28 18:31:30 [auto1.de] INFO: Scrape type for SY85938: 0
2026-03-28 18:31:30 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-28 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY45695%27 HTTP/1.1" 200 None
2026-03-28 18:31:30 [auto1.de] INFO: Scrape type for YY45695: 0
2026-03-28 18:31:30 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-28 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88975%27 HTTP/1.1" 200 None
2026-03-28 18:31:30 [auto1.de] INFO: Scrape type for ZM88975: 0
2026-03-28 18:31:30 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-28 18:31:30 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-28 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45914%27 HTTP/1.1" 200 None
2026-03-28 18:31:30 [auto1.de] INFO: Scrape type for UB45914: 0
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB91533%27 HTTP/1.1" 200 None
2026-03-28 18:31:31 [auto1.de] INFO: Scrape type for EB91533: 0
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW86422%27 HTTP/1.1" 200 None
2026-03-28 18:31:31 [auto1.de] INFO: Scrape type for NW86422: 0
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-28 18:31:31 [auto1.de] INFO: Scrape type for WN92632: 2
2026-03-28 18:31:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be8cb0d0-41f9-556b-9e1f-825682638539 with identifier: WN92632
2026-03-28 18:31:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be8cb0d0-41f9-556b-9e1f-825682638539 with scrape type 2
2026-03-28 18:31:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be8cb0d0-41f9-556b-9e1f-825682638539 with scrape type 2
2026-03-28 18:31:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be8cb0d0-41f9-556b-9e1f-825682638539, identifier: WN92632
2026-03-28 18:31:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be8cb0d0-41f9-556b-9e1f-825682638539 with identifier: WN92632
2026-03-28 18:31:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be8cb0d0-41f9-556b-9e1f-825682638539 with identifier: WN92632
2026-03-28 18:31:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be8cb0d0-41f9-556b-9e1f-825682638539 with identifier: WN92632 to the API
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:13:54Z',
 'fuel_type': 'petrol',
 'id': 'be8cb0d0-41f9-556b-9e1f-825682638539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN92632',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 121444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-07',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Innovation "110 Jahre"',
 'transmission': 'manual',
 'trim': 'Innovation "110 Jahre"',
 'year': 2009}
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN92632%27 HTTP/1.1" 200 None
2026-03-28 18:31:31 [auto1.de] INFO: Saving data for WN92632: {'auction_closing_time': 1774883634.0, 'created_time': 1774118514.126491, 'last_price_update_time': 1774722691.827855}
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN92632') HTTP/1.1" 204 0
2026-03-28 18:31:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH43382%27 HTTP/1.1" 200 None
2026-03-28 18:31:31 [auto1.de] INFO: Scrape type for UH43382: 0
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ18760%27 HTTP/1.1" 200 None
2026-03-28 18:31:31 [auto1.de] INFO: Scrape type for LJ18760: 0
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH81029%27 HTTP/1.1" 200 None
2026-03-28 18:31:31 [auto1.de] INFO: Scrape type for YH81029: 0
2026-03-28 18:31:31 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98596%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for EU98596: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26961%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for BY26961: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW87137%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for HW87137: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR77511%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for RR77511: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for FD81187: 2
2026-03-28 18:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with identifier: FD81187
2026-03-28 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with scrape type 2
2026-03-28 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with scrape type 2
2026-03-28 18:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc, identifier: FD81187
2026-03-28 18:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with identifier: FD81187
2026-03-28 18:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with identifier: FD81187
2026-03-28 18:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e3c76b9-2cc8-572d-91a5-afe9f402d1fc with identifier: FD81187 to the API
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:25:17Z',
 'fuel_type': 'petrol',
 'id': '5e3c76b9-2cc8-572d-91a5-afe9f402d1fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD81187',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3',
 'odometer': 75962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-03',
 'seller_name': None,
 'title': 'Audi S3 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2022}
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD81187%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Saving data for FD81187: {'auction_closing_time': 1774884317.0, 'created_time': 1773224653.148912, 'last_price_update_time': 1774722692.519373}
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD81187') HTTP/1.1" 204 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT08770%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for MT08770: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61709%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for VH61709: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD54604%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for TD54604: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM39243%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for JM39243: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD09262%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for CD09262: 0
2026-03-28 18:31:32 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-28 18:31:32 [auto1.de] INFO: Scrape type for SG95649: 2
2026-03-28 18:31:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63121b03-2810-5332-bf32-522e5a1e5c04 with identifier: SG95649
2026-03-28 18:31:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63121b03-2810-5332-bf32-522e5a1e5c04 with scrape type 2
2026-03-28 18:31:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63121b03-2810-5332-bf32-522e5a1e5c04 with scrape type 2
2026-03-28 18:31:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63121b03-2810-5332-bf32-522e5a1e5c04, identifier: SG95649
2026-03-28 18:31:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63121b03-2810-5332-bf32-522e5a1e5c04 with identifier: SG95649
2026-03-28 18:31:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63121b03-2810-5332-bf32-522e5a1e5c04 with identifier: SG95649
2026-03-28 18:31:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63121b03-2810-5332-bf32-522e5a1e5c04 with identifier: SG95649 to the API
2026-03-28 18:31:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:25:06Z',
 'fuel_type': 'petrol',
 'id': '63121b03-2810-5332-bf32-522e5a1e5c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG95649',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 71295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP GTi',
 'transmission': 'manual',
 'trim': 'GTi',
 'year': 2017}
2026-03-28 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG95649%27 HTTP/1.1" 200 None
2026-03-28 18:31:33 [auto1.de] INFO: Saving data for SG95649: {'auction_closing_time': 1774884306.0, 'created_time': 1774521841.913664, 'last_price_update_time': 1774722693.18569}
2026-03-28 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG95649') HTTP/1.1" 204 0
2026-03-28 18:31:33 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-28 18:31:33 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-28 18:31:33 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-28 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT85879%27 HTTP/1.1" 200 None
2026-03-28 18:31:33 [auto1.de] INFO: Scrape type for DT85879: 0
2026-03-28 18:31:33 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-28 18:31:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:34 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG01801%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for RG01801: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA93761%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for YA93761: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS20731%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for JS20731: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS69685%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for GS69685: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97689%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for SD97689: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ78917%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for ZJ78917: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA75258%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for GA75258: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG28437%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for SG28437: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP57699%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for JP57699: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB22457%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for LB22457: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA51921%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for AA51921: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE89273%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for TE89273: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT62005%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for HT62005: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT71502%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for ZT71502: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB66964%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for HB66964: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU00556%27 HTTP/1.1" 200 None
2026-03-28 18:31:34 [auto1.de] INFO: Scrape type for LU00556: 0
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-28 18:31:34 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-28 18:31:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:35 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:35 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-28 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-28 18:31:35 [auto1.de] INFO: Scrape type for NX86319: 2
2026-03-28 18:31:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7e19105-fb78-5151-8382-e43677eb0af6 with identifier: NX86319
2026-03-28 18:31:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7e19105-fb78-5151-8382-e43677eb0af6 with scrape type 2
2026-03-28 18:31:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7e19105-fb78-5151-8382-e43677eb0af6 with scrape type 2
2026-03-28 18:31:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7e19105-fb78-5151-8382-e43677eb0af6, identifier: NX86319
2026-03-28 18:31:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7e19105-fb78-5151-8382-e43677eb0af6 with identifier: NX86319
2026-03-28 18:31:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7e19105-fb78-5151-8382-e43677eb0af6 with identifier: NX86319
2026-03-28 18:31:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7e19105-fb78-5151-8382-e43677eb0af6 with identifier: NX86319 to the API
2026-03-28 18:31:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:08Z',
 'fuel_type': 'diesel',
 'id': 'b7e19105-fb78-5151-8382-e43677eb0af6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX86319',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 178176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-18',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline 4Motion',
 'transmission': 'manual',
 'trim': 'Trendline 4Motion',
 'year': 2014}
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX86319%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Saving data for NX86319: {'auction_closing_time': 1774884608.0, 'created_time': 1774118115.456932, 'last_price_update_time': 1774722696.119245}
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX86319') HTTP/1.1" 204 0
2026-03-28 18:31:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM84530%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for NM84530: 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC68587%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for RC68587: 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ51755%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for WZ51755: 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV87595%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for XV87595: 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for KY27003: 2
2026-03-28 18:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75cc02fd-91a4-5ebb-914f-199345f5f6be with identifier: KY27003
2026-03-28 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75cc02fd-91a4-5ebb-914f-199345f5f6be with scrape type 2
2026-03-28 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75cc02fd-91a4-5ebb-914f-199345f5f6be with scrape type 2
2026-03-28 18:31:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75cc02fd-91a4-5ebb-914f-199345f5f6be, identifier: KY27003
2026-03-28 18:31:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75cc02fd-91a4-5ebb-914f-199345f5f6be with identifier: KY27003
2026-03-28 18:31:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75cc02fd-91a4-5ebb-914f-199345f5f6be with identifier: KY27003
2026-03-28 18:31:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75cc02fd-91a4-5ebb-914f-199345f5f6be with identifier: KY27003 to the API
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:35:39Z',
 'fuel_type': 'petrol',
 'id': '75cc02fd-91a4-5ebb-914f-199345f5f6be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY27003',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 51587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2016}
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY27003%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Saving data for KY27003: {'auction_closing_time': 1774884939.0, 'created_time': 1774117918.573746, 'last_price_update_time': 1774722696.725867}
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY27003') HTTP/1.1" 204 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU42295%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for TU42295: 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR20197%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for KR20197: 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX84007%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for ZX84007: 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV50908%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for FV50908: 0
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-28 18:31:36 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-28 18:31:36 [auto1.de] INFO: Scrape type for SC87676: 2
2026-03-28 18:31:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with identifier: SC87676
2026-03-28 18:31:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with scrape type 2
2026-03-28 18:31:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with scrape type 2
2026-03-28 18:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3, identifier: SC87676
2026-03-28 18:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with identifier: SC87676
2026-03-28 18:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with identifier: SC87676
2026-03-28 18:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69736e8f-f4f7-5fc2-baeb-3a534c20edf3 with identifier: SC87676 to the API
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:25Z',
 'fuel_type': 'diesel',
 'id': '69736e8f-f4f7-5fc2-baeb-3a534c20edf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC87676',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 136403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-17',
 'seller_name': None,
 'title': 'Fiat Ducato 2.0 JTD 115',
 'transmission': 'manual',
 'trim': '115',
 'year': 2013}
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC87676%27 HTTP/1.1" 200 None
2026-03-28 18:31:37 [auto1.de] INFO: Saving data for SC87676: {'auction_closing_time': 1774883125.0, 'created_time': 1773467115.457249, 'last_price_update_time': 1774722697.335628}
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC87676') HTTP/1.1" 204 0
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC55438%27 HTTP/1.1" 200 None
2026-03-28 18:31:37 [auto1.de] INFO: Scrape type for CC55438: 0
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47170%27 HTTP/1.1" 200 None
2026-03-28 18:31:37 [auto1.de] INFO: Scrape type for NT47170: 0
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY96570%27 HTTP/1.1" 200 None
2026-03-28 18:31:37 [auto1.de] INFO: Scrape type for GY96570: 0
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX68266%27 HTTP/1.1" 200 None
2026-03-28 18:31:37 [auto1.de] INFO: Scrape type for DX68266: 0
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-28 18:31:37 [auto1.de] INFO: Scrape type for RN81514: 2
2026-03-28 18:31:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with identifier: RN81514
2026-03-28 18:31:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with scrape type 2
2026-03-28 18:31:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with scrape type 2
2026-03-28 18:31:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6, identifier: RN81514
2026-03-28 18:31:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with identifier: RN81514
2026-03-28 18:31:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with identifier: RN81514
2026-03-28 18:31:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7ffac15-6a06-5ea3-b4e6-895f3267f1e6 with identifier: RN81514 to the API
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:29:21Z',
 'fuel_type': 'diesel',
 'id': 'b7ffac15-6a06-5ea3-b4e6-895f3267f1e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN81514',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 151383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-05',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN81514%27 HTTP/1.1" 200 None
2026-03-28 18:31:37 [auto1.de] INFO: Saving data for RN81514: {'auction_closing_time': 1774884561.0, 'created_time': 1773916536.864025, 'last_price_update_time': 1774722697.856606}
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN81514') HTTP/1.1" 204 0
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC60552%27 HTTP/1.1" 200 None
2026-03-28 18:31:37 [auto1.de] INFO: Scrape type for UC60552: 0
2026-03-28 18:31:37 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-28 18:31:38 [auto1.de] INFO: Scrape type for FY99153: 2
2026-03-28 18:31:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a3e8608-53b0-5d36-b2d4-3136604c0247 with identifier: FY99153
2026-03-28 18:31:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a3e8608-53b0-5d36-b2d4-3136604c0247 with scrape type 2
2026-03-28 18:31:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a3e8608-53b0-5d36-b2d4-3136604c0247 with scrape type 2
2026-03-28 18:31:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a3e8608-53b0-5d36-b2d4-3136604c0247, identifier: FY99153
2026-03-28 18:31:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a3e8608-53b0-5d36-b2d4-3136604c0247 with identifier: FY99153
2026-03-28 18:31:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a3e8608-53b0-5d36-b2d4-3136604c0247 with identifier: FY99153
2026-03-28 18:31:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a3e8608-53b0-5d36-b2d4-3136604c0247 with identifier: FY99153 to the API
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:50:41Z',
 'fuel_type': 'petrol',
 'id': '7a3e8608-53b0-5d36-b2d4-3136604c0247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY99153',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 153976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-13',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY99153%27 HTTP/1.1" 200 None
2026-03-28 18:31:38 [auto1.de] INFO: Saving data for FY99153: {'auction_closing_time': 1774885841.0, 'created_time': 1774521841.121547, 'last_price_update_time': 1774722698.541815}
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY99153') HTTP/1.1" 204 0
2026-03-28 18:31:38 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-28 18:31:38 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA10285%27 HTTP/1.1" 200 None
2026-03-28 18:31:38 [auto1.de] INFO: Scrape type for SA10285: 0
2026-03-28 18:31:38 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-28 18:31:38 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24864%27 HTTP/1.1" 200 None
2026-03-28 18:31:38 [auto1.de] INFO: Scrape type for PG24864: 0
2026-03-28 18:31:38 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-28 18:31:38 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM43491%27 HTTP/1.1" 200 None
2026-03-28 18:31:38 [auto1.de] INFO: Scrape type for MM43491: 0
2026-03-28 18:31:38 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-28 18:31:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:39 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ41763%27 HTTP/1.1" 200 None
2026-03-28 18:31:39 [auto1.de] INFO: Scrape type for VJ41763: 0
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN00007%27 HTTP/1.1" 200 None
2026-03-28 18:31:39 [auto1.de] INFO: Scrape type for FN00007: 0
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01132%27 HTTP/1.1" 200 None
2026-03-28 18:31:39 [auto1.de] INFO: Scrape type for KE01132: 0
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN05463%27 HTTP/1.1" 200 None
2026-03-28 18:31:39 [auto1.de] INFO: Scrape type for BN05463: 0
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-28 18:31:39 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-28 18:31:39 [auto1.de] INFO: Scrape type for LY63644: 2
2026-03-28 18:31:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a25f4c2d-a775-539c-9ddf-65c39cf229f2 with identifier: LY63644
2026-03-28 18:31:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a25f4c2d-a775-539c-9ddf-65c39cf229f2 with scrape type 2
2026-03-28 18:31:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a25f4c2d-a775-539c-9ddf-65c39cf229f2 with scrape type 2
2026-03-28 18:31:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a25f4c2d-a775-539c-9ddf-65c39cf229f2, identifier: LY63644
2026-03-28 18:31:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a25f4c2d-a775-539c-9ddf-65c39cf229f2 with identifier: LY63644
2026-03-28 18:31:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a25f4c2d-a775-539c-9ddf-65c39cf229f2 with identifier: LY63644
2026-03-28 18:31:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a25f4c2d-a775-539c-9ddf-65c39cf229f2 with identifier: LY63644 to the API
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:02:54Z',
 'fuel_type': 'petrol',
 'id': 'a25f4c2d-a775-539c-9ddf-65c39cf229f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY63644',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 21797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-28 18:31:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY63644%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Saving data for LY63644: {'auction_closing_time': 1774882974.0, 'created_time': 1774522281.733863, 'last_price_update_time': 1774722700.006646}
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY63644') HTTP/1.1" 204 0
2026-03-28 18:31:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU33020%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for KU33020: 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for UE61705: 2
2026-03-28 18:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with identifier: UE61705
2026-03-28 18:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with scrape type 2
2026-03-28 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with scrape type 2
2026-03-28 18:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21, identifier: UE61705
2026-03-28 18:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with identifier: UE61705
2026-03-28 18:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with identifier: UE61705
2026-03-28 18:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21 with identifier: UE61705 to the API
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:01:43Z',
 'fuel_type': 'diesel',
 'id': '7ba9fe74-bbef-52a0-ac49-5ccbfbaf1e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE61705',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 293905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE61705%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Saving data for UE61705: {'auction_closing_time': 1774882903.0, 'created_time': 1774521621.513815, 'last_price_update_time': 1774722700.565804}
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE61705') HTTP/1.1" 204 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH20515%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for LH20515: 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES42650%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for ES42650: 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR74072%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for XR74072: 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED89448%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for ED89448: 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF00681%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for SF00681: 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE41577%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for ZE41577: 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA81936%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for SA81936: 0
2026-03-28 18:31:40 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-28 18:31:40 [auto1.de] INFO: Scrape type for JE00015: 2
2026-03-28 18:31:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6176f648-b148-5cf4-b041-49aeb3343586 with identifier: JE00015
2026-03-28 18:31:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6176f648-b148-5cf4-b041-49aeb3343586 with scrape type 2
2026-03-28 18:31:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6176f648-b148-5cf4-b041-49aeb3343586 with scrape type 2
2026-03-28 18:31:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6176f648-b148-5cf4-b041-49aeb3343586, identifier: JE00015
2026-03-28 18:31:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6176f648-b148-5cf4-b041-49aeb3343586 with identifier: JE00015
2026-03-28 18:31:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6176f648-b148-5cf4-b041-49aeb3343586 with identifier: JE00015
2026-03-28 18:31:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6176f648-b148-5cf4-b041-49aeb3343586 with identifier: JE00015 to the API
2026-03-28 18:31:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:08Z',
 'fuel_type': 'diesel',
 'id': '6176f648-b148-5cf4-b041-49aeb3343586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE00015',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 131026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-06',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE00015%27 HTTP/1.1" 200 None
2026-03-28 18:31:41 [auto1.de] INFO: Saving data for JE00015: {'auction_closing_time': 1774883588.0, 'created_time': 1773427063.737864, 'last_price_update_time': 1774722701.185839}
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE00015') HTTP/1.1" 204 0
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS46633%27 HTTP/1.1" 200 None
2026-03-28 18:31:41 [auto1.de] INFO: Scrape type for ZS46633: 0
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: US49854
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM95943%27 HTTP/1.1" 200 None
2026-03-28 18:31:41 [auto1.de] INFO: Scrape type for UM95943: 0
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ32972%27 HTTP/1.1" 200 None
2026-03-28 18:31:41 [auto1.de] INFO: Scrape type for NZ32972: 0
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD14847%27 HTTP/1.1" 200 None
2026-03-28 18:31:41 [auto1.de] INFO: Scrape type for UD14847: 0
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS64432%27 HTTP/1.1" 200 None
2026-03-28 18:31:41 [auto1.de] INFO: Scrape type for JS64432: 0
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: NG35588
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG35588%27 HTTP/1.1" 200 None
2026-03-28 18:31:41 [auto1.de] INFO: Scrape type for NG35588: 0
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-28 18:31:41 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB74366%27 HTTP/1.1" 200 None
2026-03-28 18:31:41 [auto1.de] INFO: Scrape type for ZB74366: 0
2026-03-28 18:31:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:42 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39713%27 HTTP/1.1" 200 None
2026-03-28 18:31:42 [auto1.de] INFO: Scrape type for KF39713: 0
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY11970%27 HTTP/1.1" 200 None
2026-03-28 18:31:42 [auto1.de] INFO: Scrape type for GY11970: 0
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD66077%27 HTTP/1.1" 200 None
2026-03-28 18:31:42 [auto1.de] INFO: Scrape type for BD66077: 0
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR26970%27 HTTP/1.1" 200 None
2026-03-28 18:31:42 [auto1.de] INFO: Scrape type for XR26970: 0
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG64287%27 HTTP/1.1" 200 None
2026-03-28 18:31:42 [auto1.de] INFO: Scrape type for AG64287: 0
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF57036%27 HTTP/1.1" 200 None
2026-03-28 18:31:42 [auto1.de] INFO: Scrape type for BF57036: 0
2026-03-28 18:31:42 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-28 18:31:42 [auto1.de] INFO: Scrape type for VU33733: 2
2026-03-28 18:31:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with identifier: VU33733
2026-03-28 18:31:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with scrape type 2
2026-03-28 18:31:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with scrape type 2
2026-03-28 18:31:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6e8f7d5-a5c0-5e88-88da-279c9a87f349, identifier: VU33733
2026-03-28 18:31:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with identifier: VU33733
2026-03-28 18:31:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with identifier: VU33733
2026-03-28 18:31:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6e8f7d5-a5c0-5e88-88da-279c9a87f349 with identifier: VU33733 to the API
2026-03-28 18:31:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:18:05Z',
 'fuel_type': 'petrol',
 'id': 'a6e8f7d5-a5c0-5e88-88da-279c9a87f349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU33733',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 187259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU33733%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Saving data for VU33733: {'auction_closing_time': 1774883885.0, 'created_time': 1774349758.791307, 'last_price_update_time': 1774722703.135526}
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU33733') HTTP/1.1" 204 0
2026-03-28 18:31:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF75644%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for MF75644: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48468%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for MY48468: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK95510%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for FK95510: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS37801%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for BS37801: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC57196%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for UC57196: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93130%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for GG93130: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML06015%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for ML06015: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for TU08005: 2
2026-03-28 18:31:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a36c230-c7de-509b-8e4b-77ad15c3b528 with identifier: TU08005
2026-03-28 18:31:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a36c230-c7de-509b-8e4b-77ad15c3b528 with scrape type 2
2026-03-28 18:31:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a36c230-c7de-509b-8e4b-77ad15c3b528 with scrape type 2
2026-03-28 18:31:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a36c230-c7de-509b-8e4b-77ad15c3b528, identifier: TU08005
2026-03-28 18:31:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a36c230-c7de-509b-8e4b-77ad15c3b528 with identifier: TU08005
2026-03-28 18:31:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a36c230-c7de-509b-8e4b-77ad15c3b528 with identifier: TU08005
2026-03-28 18:31:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a36c230-c7de-509b-8e4b-77ad15c3b528 with identifier: TU08005 to the API
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:06:45Z',
 'fuel_type': 'petrol',
 'id': '3a36c230-c7de-509b-8e4b-77ad15c3b528',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU08005',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 202541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-09-03',
 'seller_name': None,
 'title': 'Audi A6 2.8 V6',
 'transmission': 'automatic',
 'trim': '',
 'year': 1998}
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU08005%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Saving data for TU08005: {'auction_closing_time': 1774883205.0, 'created_time': 1774034452.587275, 'last_price_update_time': 1774722703.774808}
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU08005') HTTP/1.1" 204 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC31654%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for UC31654: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35268%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for NR35268: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV18739%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for TV18739: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD76809%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for CD76809: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE77460%27 HTTP/1.1" 200 None
2026-03-28 18:31:43 [auto1.de] INFO: Scrape type for EE77460: 0
2026-03-28 18:31:43 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-28 18:31:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:44 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:44 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-28 18:31:44 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-28 18:31:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS26285%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for KS26285: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH46132%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for KH46132: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ42738%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for GJ42738: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF55006%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for XF55006: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF88464%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for AF88464: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39650%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for EG39650: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89104%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for HA89104: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM27996%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for DM27996: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for AA46272: 2
2026-03-28 18:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723feae3-4ae9-504d-a75a-1bfde2e289fc with identifier: AA46272
2026-03-28 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723feae3-4ae9-504d-a75a-1bfde2e289fc with scrape type 2
2026-03-28 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 723feae3-4ae9-504d-a75a-1bfde2e289fc with scrape type 2
2026-03-28 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 723feae3-4ae9-504d-a75a-1bfde2e289fc, identifier: AA46272
2026-03-28 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 723feae3-4ae9-504d-a75a-1bfde2e289fc with identifier: AA46272
2026-03-28 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 723feae3-4ae9-504d-a75a-1bfde2e289fc with identifier: AA46272
2026-03-28 18:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 723feae3-4ae9-504d-a75a-1bfde2e289fc with identifier: AA46272 to the API
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:02:05Z',
 'fuel_type': 'petrol',
 'id': '723feae3-4ae9-504d-a75a-1bfde2e289fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA46272',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 61934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-18',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA46272%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Saving data for AA46272: {'auction_closing_time': 1774882925.0, 'created_time': 1774636256.127426, 'last_price_update_time': 1774722705.569235}
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA46272') HTTP/1.1" 204 0
2026-03-28 18:31:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT53548%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for ZT53548: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG77480%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for XG77480: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM78577%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for AM78577: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR92717%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for FR92717: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL19832%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for RL19832: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02841%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for FB02841: 0
2026-03-28 18:31:45 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-28 18:31:45 [auto1.de] INFO: Scrape type for PW12132: 2
2026-03-28 18:31:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-03-28 18:31:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e801c8b0-4bce-5ff9-90dd-820987634a68 with scrape type 2
2026-03-28 18:31:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e801c8b0-4bce-5ff9-90dd-820987634a68 with scrape type 2
2026-03-28 18:31:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e801c8b0-4bce-5ff9-90dd-820987634a68, identifier: PW12132
2026-03-28 18:31:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-03-28 18:31:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132
2026-03-28 18:31:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e801c8b0-4bce-5ff9-90dd-820987634a68 with identifier: PW12132 to the API
2026-03-28 18:31:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:34:32Z',
 'fuel_type': 'diesel',
 'id': 'e801c8b0-4bce-5ff9-90dd-820987634a68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW12132',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 97495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW12132%27 HTTP/1.1" 200 None
2026-03-28 18:31:46 [auto1.de] INFO: Saving data for PW12132: {'auction_closing_time': 1774884872.0, 'created_time': 1774118553.342233, 'last_price_update_time': 1774722706.235789}
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW12132') HTTP/1.1" 204 0
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-28 18:31:46 [auto1.de] INFO: Scrape type for NT04254: 2
2026-03-28 18:31:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with identifier: NT04254
2026-03-28 18:31:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with scrape type 2
2026-03-28 18:31:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with scrape type 2
2026-03-28 18:31:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba, identifier: NT04254
2026-03-28 18:31:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with identifier: NT04254
2026-03-28 18:31:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with identifier: NT04254
2026-03-28 18:31:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba with identifier: NT04254 to the API
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:55:46Z',
 'fuel_type': 'petrol',
 'id': 'fc144ef1-9ec5-5a16-b0fb-88771bcaf7ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT04254',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 112135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-27',
 'seller_name': None,
 'title': 'Fiat 500 1.2 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2013}
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT04254%27 HTTP/1.1" 200 None
2026-03-28 18:31:46 [auto1.de] INFO: Saving data for NT04254: {'auction_closing_time': 1774886146.0, 'created_time': 1774522465.74423, 'last_price_update_time': 1774722706.800838}
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT04254') HTTP/1.1" 204 0
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL62984%27 HTTP/1.1" 200 None
2026-03-28 18:31:46 [auto1.de] INFO: Scrape type for CL62984: 0
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91786%27 HTTP/1.1" 200 None
2026-03-28 18:31:46 [auto1.de] INFO: Scrape type for GV91786: 0
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68921%27 HTTP/1.1" 200 None
2026-03-28 18:31:46 [auto1.de] INFO: Scrape type for JV68921: 0
2026-03-28 18:31:46 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE12352%27 HTTP/1.1" 200 None
2026-03-28 18:31:46 [auto1.de] INFO: Scrape type for FE12352: 0
2026-03-28 18:31:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:47 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:47 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-28 18:31:47 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-28 18:31:47 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-28 18:31:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH02109%27 HTTP/1.1" 200 None
2026-03-28 18:31:48 [auto1.de] INFO: Scrape type for GH02109: 0
2026-03-28 18:31:48 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-28 18:31:48 [auto1.de] INFO: Scrape type for FP33840: 2
2026-03-28 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de138e96-183e-5b14-9d60-2a18e3525655 with identifier: FP33840
2026-03-28 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de138e96-183e-5b14-9d60-2a18e3525655 with scrape type 2
2026-03-28 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de138e96-183e-5b14-9d60-2a18e3525655 with scrape type 2
2026-03-28 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de138e96-183e-5b14-9d60-2a18e3525655, identifier: FP33840
2026-03-28 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de138e96-183e-5b14-9d60-2a18e3525655 with identifier: FP33840
2026-03-28 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de138e96-183e-5b14-9d60-2a18e3525655 with identifier: FP33840
2026-03-28 18:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de138e96-183e-5b14-9d60-2a18e3525655 with identifier: FP33840 to the API
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:10:13Z',
 'fuel_type': 'petrol',
 'id': 'de138e96-183e-5b14-9d60-2a18e3525655',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP33840',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 139611,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-18',
 'seller_name': None,
 'title': 'Toyota Avensis 1.8 Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2012}
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP33840%27 HTTP/1.1" 200 None
2026-03-28 18:31:48 [auto1.de] INFO: Saving data for FP33840: {'auction_closing_time': 1774883413.0, 'created_time': 1774350164.941479, 'last_price_update_time': 1774722708.446288}
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP33840') HTTP/1.1" 204 0
2026-03-28 18:31:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:48 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM74095%27 HTTP/1.1" 200 None
2026-03-28 18:31:48 [auto1.de] INFO: Scrape type for CM74095: 0
2026-03-28 18:31:48 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-28 18:31:48 [auto1.de] INFO: Scrape type for LM10122: 2
2026-03-28 18:31:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc8ce052-d13c-5efe-98af-da2a20439cbe with identifier: LM10122
2026-03-28 18:31:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc8ce052-d13c-5efe-98af-da2a20439cbe with scrape type 2
2026-03-28 18:31:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc8ce052-d13c-5efe-98af-da2a20439cbe with scrape type 2
2026-03-28 18:31:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc8ce052-d13c-5efe-98af-da2a20439cbe, identifier: LM10122
2026-03-28 18:31:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc8ce052-d13c-5efe-98af-da2a20439cbe with identifier: LM10122
2026-03-28 18:31:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc8ce052-d13c-5efe-98af-da2a20439cbe with identifier: LM10122
2026-03-28 18:31:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc8ce052-d13c-5efe-98af-da2a20439cbe with identifier: LM10122 to the API
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:24:38Z',
 'fuel_type': 'diesel',
 'id': 'fc8ce052-d13c-5efe-98af-da2a20439cbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM10122',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 206068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-01',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2015}
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10122%27 HTTP/1.1" 200 None
2026-03-28 18:31:48 [auto1.de] INFO: Saving data for LM10122: {'auction_closing_time': 1774884278.0, 'created_time': 1772728077.692988, 'last_price_update_time': 1774722708.986338}
2026-03-28 18:31:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM10122') HTTP/1.1" 204 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE40568%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for ZE40568: 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for VU50436: 2
2026-03-28 18:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f3ba892-7db0-5ece-8e39-8c05d342956b with identifier: VU50436
2026-03-28 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f3ba892-7db0-5ece-8e39-8c05d342956b with scrape type 2
2026-03-28 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f3ba892-7db0-5ece-8e39-8c05d342956b with scrape type 2
2026-03-28 18:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f3ba892-7db0-5ece-8e39-8c05d342956b, identifier: VU50436
2026-03-28 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f3ba892-7db0-5ece-8e39-8c05d342956b with identifier: VU50436
2026-03-28 18:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f3ba892-7db0-5ece-8e39-8c05d342956b with identifier: VU50436
2026-03-28 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f3ba892-7db0-5ece-8e39-8c05d342956b with identifier: VU50436 to the API
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:29:56Z',
 'fuel_type': 'diesel',
 'id': '2f3ba892-7db0-5ece-8e39-8c05d342956b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU50436',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 25223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-26',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU50436%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Saving data for VU50436: {'auction_closing_time': 1774884596.0, 'created_time': 1774521671.545626, 'last_price_update_time': 1774722709.458678}
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU50436') HTTP/1.1" 204 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG45518%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for HG45518: 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC83292%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for FC83292: 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN89832%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for GN89832: 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17232%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for RE17232: 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP66494%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for UP66494: 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ82118%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for GJ82118: 0
2026-03-28 18:31:49 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-28 18:31:49 [auto1.de] INFO: Scrape type for HB62696: 2
2026-03-28 18:31:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66152524-5a4b-5c42-8de7-d380e16c5d62 with identifier: HB62696
2026-03-28 18:31:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66152524-5a4b-5c42-8de7-d380e16c5d62 with scrape type 2
2026-03-28 18:31:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66152524-5a4b-5c42-8de7-d380e16c5d62 with scrape type 2
2026-03-28 18:31:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66152524-5a4b-5c42-8de7-d380e16c5d62, identifier: HB62696
2026-03-28 18:31:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66152524-5a4b-5c42-8de7-d380e16c5d62 with identifier: HB62696
2026-03-28 18:31:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66152524-5a4b-5c42-8de7-d380e16c5d62 with identifier: HB62696
2026-03-28 18:31:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66152524-5a4b-5c42-8de7-d380e16c5d62 with identifier: HB62696 to the API
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:11:53Z',
 'fuel_type': 'diesel',
 'id': '66152524-5a4b-5c42-8de7-d380e16c5d62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB62696',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 296249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-13',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB62696%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Saving data for HB62696: {'auction_closing_time': 1774883513.0, 'created_time': 1773468131.369097, 'last_price_update_time': 1774722710.018226}
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB62696') HTTP/1.1" 204 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF27156%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for BF27156: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE52706%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for KE52706: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87284%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for FK87284: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR38241%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for DR38241: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP78735%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for BP78735: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP61369%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for YP61369: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ94866%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for XZ94866: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX13516%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for VX13516: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV91076%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for DV91076: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK19800%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for KK19800: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34969%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for JN34969: 0
2026-03-28 18:31:50 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC36065%27 HTTP/1.1" 200 None
2026-03-28 18:31:50 [auto1.de] INFO: Scrape type for NC36065: 0
2026-03-28 18:31:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:51 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW47494%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for EW47494: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET79003%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for ET79003: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85706%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for LM85706: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA05422%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for LA05422: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL85665%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for VL85665: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY09596%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for WY09596: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM50493%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for NM50493: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF79085%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for RF79085: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for KN80130: 2
2026-03-28 18:31:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14d5bc4c-8e3f-57fc-86ac-017d2959955e with identifier: KN80130
2026-03-28 18:31:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14d5bc4c-8e3f-57fc-86ac-017d2959955e with scrape type 2
2026-03-28 18:31:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14d5bc4c-8e3f-57fc-86ac-017d2959955e with scrape type 2
2026-03-28 18:31:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14d5bc4c-8e3f-57fc-86ac-017d2959955e, identifier: KN80130
2026-03-28 18:31:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14d5bc4c-8e3f-57fc-86ac-017d2959955e with identifier: KN80130
2026-03-28 18:31:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14d5bc4c-8e3f-57fc-86ac-017d2959955e with identifier: KN80130
2026-03-28 18:31:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14d5bc4c-8e3f-57fc-86ac-017d2959955e with identifier: KN80130 to the API
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:04:54Z',
 'fuel_type': 'diesel',
 'id': '14d5bc4c-8e3f-57fc-86ac-017d2959955e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN80130',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 69871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-16',
 'seller_name': None,
 'title': 'Opel Movano 2.3 CDTI Ka L1H1 3,5t',
 'transmission': 'manual',
 'trim': 'Ka L1H1 3,5t',
 'year': 2012}
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN80130%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Saving data for KN80130: {'auction_closing_time': 1774883094.0, 'created_time': 1774522093.224323, 'last_price_update_time': 1774722711.698701}
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN80130') HTTP/1.1" 204 0
2026-03-28 18:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX50860%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for KX50860: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE25239%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for BE25239: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12001%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for LK12001: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH47357%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for GH47357: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for RU25678: 1
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM88762%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for ZM88762: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV09290%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for GV09290: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS02767%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for YS02767: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL90594%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for KL90594: 0
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-28 18:31:51 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ68133%27 HTTP/1.1" 200 None
2026-03-28 18:31:51 [auto1.de] INFO: Scrape type for JZ68133: 0
2026-03-28 18:31:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:53 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW15548%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for YW15548: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW12270%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for KW12270: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01657%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for DX01657: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP90284%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for DP90284: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT77440%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for DT77440: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP43977%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for CP43977: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM87247%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for KM87247: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME45713%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for ME45713: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR04535%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for KR04535: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90391%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for UZ90391: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN10477%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for YN10477: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB87355%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for AB87355: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP28886%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for WP28886: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for KV78740: 1
2026-03-28 18:31:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT10354%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for RT10354: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20301%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for ZN20301: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28576%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for ZD28576: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC78476%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for EC78476: 0
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-28 18:31:53 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE63795%27 HTTP/1.1" 200 None
2026-03-28 18:31:53 [auto1.de] INFO: Scrape type for RE63795: 0
2026-03-28 18:31:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:54 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:54 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-28 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-28 18:31:54 [auto1.de] INFO: Scrape type for BA95413: 2
2026-03-28 18:31:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 209680f7-879f-5628-8420-7e000da37405 with identifier: BA95413
2026-03-28 18:31:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 209680f7-879f-5628-8420-7e000da37405 with scrape type 2
2026-03-28 18:31:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 209680f7-879f-5628-8420-7e000da37405 with scrape type 2
2026-03-28 18:31:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 209680f7-879f-5628-8420-7e000da37405, identifier: BA95413
2026-03-28 18:31:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 209680f7-879f-5628-8420-7e000da37405 with identifier: BA95413
2026-03-28 18:31:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 209680f7-879f-5628-8420-7e000da37405 with identifier: BA95413
2026-03-28 18:31:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 209680f7-879f-5628-8420-7e000da37405 with identifier: BA95413 to the API
2026-03-28 18:31:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:45:44Z',
 'fuel_type': 'petrol',
 'id': '209680f7-879f-5628-8420-7e000da37405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA95413',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 181854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-16',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-28 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA95413%27 HTTP/1.1" 200 None
2026-03-28 18:31:54 [auto1.de] INFO: Saving data for BA95413: {'auction_closing_time': 1774885544.0, 'created_time': 1774522033.34082, 'last_price_update_time': 1774722714.938761}
2026-03-28 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA95413') HTTP/1.1" 204 0
2026-03-28 18:31:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL62342%27 HTTP/1.1" 200 None
2026-03-28 18:31:55 [auto1.de] INFO: Scrape type for XL62342: 0
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB31140%27 HTTP/1.1" 200 None
2026-03-28 18:31:55 [auto1.de] INFO: Scrape type for FB31140: 0
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU57590%27 HTTP/1.1" 200 None
2026-03-28 18:31:55 [auto1.de] INFO: Scrape type for HU57590: 0
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72792%27 HTTP/1.1" 200 None
2026-03-28 18:31:55 [auto1.de] INFO: Scrape type for MZ72792: 0
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV94095%27 HTTP/1.1" 200 None
2026-03-28 18:31:55 [auto1.de] INFO: Scrape type for WV94095: 0
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-28 18:31:55 [auto1.de] INFO: Scrape type for PD00543: 2
2026-03-28 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with identifier: PD00543
2026-03-28 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with scrape type 2
2026-03-28 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with scrape type 2
2026-03-28 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0, identifier: PD00543
2026-03-28 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with identifier: PD00543
2026-03-28 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with identifier: PD00543
2026-03-28 18:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 600af1cc-4f9a-5a0f-bfa5-1114933aa7b0 with identifier: PD00543 to the API
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:12:52Z',
 'fuel_type': 'petrol',
 'id': '600af1cc-4f9a-5a0f-bfa5-1114933aa7b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD00543',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 167249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-24',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 280',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD00543%27 HTTP/1.1" 200 None
2026-03-28 18:31:55 [auto1.de] INFO: Saving data for PD00543: {'auction_closing_time': 1774883572.0, 'created_time': 1774636289.494853, 'last_price_update_time': 1774722715.553586}
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD00543') HTTP/1.1" 204 0
2026-03-28 18:31:55 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-28 18:31:55 [auto1.de] INFO: Scrape type for HB06049: 2
2026-03-28 18:31:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbae2502-4fc3-5fff-aa2d-081a69e05020 with identifier: HB06049
2026-03-28 18:31:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbae2502-4fc3-5fff-aa2d-081a69e05020 with scrape type 2
2026-03-28 18:31:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbae2502-4fc3-5fff-aa2d-081a69e05020 with scrape type 2
2026-03-28 18:31:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbae2502-4fc3-5fff-aa2d-081a69e05020, identifier: HB06049
2026-03-28 18:31:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbae2502-4fc3-5fff-aa2d-081a69e05020 with identifier: HB06049
2026-03-28 18:31:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbae2502-4fc3-5fff-aa2d-081a69e05020 with identifier: HB06049
2026-03-28 18:31:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbae2502-4fc3-5fff-aa2d-081a69e05020 with identifier: HB06049 to the API
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:24:47Z',
 'fuel_type': 'diesel',
 'id': 'bbae2502-4fc3-5fff-aa2d-081a69e05020',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB06049',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 113533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-06',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-28 18:31:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB06049%27 HTTP/1.1" 200 None
2026-03-28 18:31:56 [auto1.de] INFO: Saving data for HB06049: {'auction_closing_time': 1774884287.0, 'created_time': 1774522557.06571, 'last_price_update_time': 1774722716.01025}
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB06049') HTTP/1.1" 204 0
2026-03-28 18:31:56 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-28 18:31:56 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ60837%27 HTTP/1.1" 200 None
2026-03-28 18:31:56 [auto1.de] INFO: Scrape type for BJ60837: 0
2026-03-28 18:31:56 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-28 18:31:56 [auto1.de] INFO: Scrape type for VL06718: 2
2026-03-28 18:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c21ef52-7a31-5346-8491-018a7e2fabe6 with identifier: VL06718
2026-03-28 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c21ef52-7a31-5346-8491-018a7e2fabe6 with scrape type 2
2026-03-28 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c21ef52-7a31-5346-8491-018a7e2fabe6 with scrape type 2
2026-03-28 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c21ef52-7a31-5346-8491-018a7e2fabe6, identifier: VL06718
2026-03-28 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c21ef52-7a31-5346-8491-018a7e2fabe6 with identifier: VL06718
2026-03-28 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c21ef52-7a31-5346-8491-018a7e2fabe6 with identifier: VL06718
2026-03-28 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c21ef52-7a31-5346-8491-018a7e2fabe6 with identifier: VL06718 to the API
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:21:21Z',
 'fuel_type': 'petrol',
 'id': '3c21ef52-7a31-5346-8491-018a7e2fabe6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL06718',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 149571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06718%27 HTTP/1.1" 200 None
2026-03-28 18:31:56 [auto1.de] INFO: Saving data for VL06718: {'auction_closing_time': 1774884081.0, 'created_time': 1773946276.228327, 'last_price_update_time': 1774722716.467377}
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL06718') HTTP/1.1" 204 0
2026-03-28 18:31:56 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-28 18:31:56 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU27539%27 HTTP/1.1" 200 None
2026-03-28 18:31:56 [auto1.de] INFO: Scrape type for DU27539: 0
2026-03-28 18:31:56 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-28 18:31:56 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-28 18:31:56 [auto1.de] INFO: Scrape type for LJ93781: 2
2026-03-28 18:31:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9168d46b-094a-5615-8785-1f1e6fe0e980 with identifier: LJ93781
2026-03-28 18:31:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9168d46b-094a-5615-8785-1f1e6fe0e980 with scrape type 2
2026-03-28 18:31:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9168d46b-094a-5615-8785-1f1e6fe0e980 with scrape type 2
2026-03-28 18:31:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9168d46b-094a-5615-8785-1f1e6fe0e980, identifier: LJ93781
2026-03-28 18:31:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9168d46b-094a-5615-8785-1f1e6fe0e980 with identifier: LJ93781
2026-03-28 18:31:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9168d46b-094a-5615-8785-1f1e6fe0e980 with identifier: LJ93781
2026-03-28 18:31:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9168d46b-094a-5615-8785-1f1e6fe0e980 with identifier: LJ93781 to the API
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:42:26Z',
 'fuel_type': 'petrol',
 'id': '9168d46b-094a-5615-8785-1f1e6fe0e980',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ93781',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 85348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-11',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2014}
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ93781%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Saving data for LJ93781: {'auction_closing_time': 1774885346.0, 'created_time': 1774117856.319088, 'last_price_update_time': 1774722717.022009}
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ93781') HTTP/1.1" 204 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN03307%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for RN03307: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77035%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for UR77035: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN66597%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for NN66597: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN95759%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for YN95759: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB13325%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for HB13325: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU04810%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for FU04810: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG14564%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for VG14564: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY54008%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for WY54008: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17780%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for JR17780: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-28 18:31:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:31:57 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 5993 | hits on page: 40
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED00109%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for ED00109: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV91046%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for GV91046: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG07323%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for FG07323: 0
2026-03-28 18:31:57 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-28 18:31:57 [auto1.de] INFO: Scrape type for RZ48384: 2
2026-03-28 18:31:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f559f79e-fffe-5004-bbe2-db2ea64f0b58 with identifier: RZ48384
2026-03-28 18:31:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f559f79e-fffe-5004-bbe2-db2ea64f0b58 with scrape type 2
2026-03-28 18:31:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f559f79e-fffe-5004-bbe2-db2ea64f0b58 with scrape type 2
2026-03-28 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f559f79e-fffe-5004-bbe2-db2ea64f0b58, identifier: RZ48384
2026-03-28 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f559f79e-fffe-5004-bbe2-db2ea64f0b58 with identifier: RZ48384
2026-03-28 18:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f559f79e-fffe-5004-bbe2-db2ea64f0b58 with identifier: RZ48384
2026-03-28 18:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f559f79e-fffe-5004-bbe2-db2ea64f0b58 with identifier: RZ48384 to the API
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:16:25Z',
 'fuel_type': 'diesel',
 'id': 'f559f79e-fffe-5004-bbe2-db2ea64f0b58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ48384',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 100011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-07',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L1 Tourneo Titanium',
 'transmission': 'automatic',
 'trim': '310 L1 Tourneo Titanium',
 'year': 2018}
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ48384%27 HTTP/1.1" 200 None
2026-03-28 18:31:58 [auto1.de] INFO: Saving data for RZ48384: {'auction_closing_time': 1774883785.0, 'created_time': 1774522204.826056, 'last_price_update_time': 1774722718.401412}
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ48384') HTTP/1.1" 204 0
2026-03-28 18:31:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:31:58 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-28 18:31:58 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-28 18:31:58 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-28 18:31:58 [auto1.de] INFO: Scrape type for SB60272: 2
2026-03-28 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a54ebecf-f303-520e-bb68-6165f57ad412 with identifier: SB60272
2026-03-28 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a54ebecf-f303-520e-bb68-6165f57ad412 with scrape type 2
2026-03-28 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a54ebecf-f303-520e-bb68-6165f57ad412 with scrape type 2
2026-03-28 18:31:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a54ebecf-f303-520e-bb68-6165f57ad412, identifier: SB60272
2026-03-28 18:31:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a54ebecf-f303-520e-bb68-6165f57ad412 with identifier: SB60272
2026-03-28 18:31:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a54ebecf-f303-520e-bb68-6165f57ad412 with identifier: SB60272
2026-03-28 18:31:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a54ebecf-f303-520e-bb68-6165f57ad412 with identifier: SB60272 to the API
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:19:29Z',
 'fuel_type': 'diesel',
 'id': 'a54ebecf-f303-520e-bb68-6165f57ad412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB60272',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 231736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-18',
 'seller_name': None,
 'title': 'BMW X3 3.0d',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB60272%27 HTTP/1.1" 200 None
2026-03-28 18:31:58 [auto1.de] INFO: Saving data for SB60272: {'auction_closing_time': 1774883969.0, 'created_time': 1773227303.319269, 'last_price_update_time': 1774722718.940868}
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB60272') HTTP/1.1" 204 0
2026-03-28 18:31:58 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA42145%27 HTTP/1.1" 200 None
2026-03-28 18:31:58 [auto1.de] INFO: Scrape type for GA42145: 0
2026-03-28 18:31:58 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-28 18:31:58 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-28 18:31:58 [auto1.de] INFO: Scrape type for XY68410: 2
2026-03-28 18:31:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with identifier: XY68410
2026-03-28 18:31:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with scrape type 2
2026-03-28 18:31:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with scrape type 2
2026-03-28 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461, identifier: XY68410
2026-03-28 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with identifier: XY68410
2026-03-28 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with identifier: XY68410
2026-03-28 18:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e48f5d-fbf0-519e-a51e-30bb3a5e6461 with identifier: XY68410 to the API
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:36:23Z',
 'fuel_type': 'diesel',
 'id': '02e48f5d-fbf0-519e-a51e-30bb3a5e6461',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY68410',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 259815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-07',
 'seller_name': None,
 'title': 'BMW 3er 318d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY68410%27 HTTP/1.1" 200 None
2026-03-28 18:31:59 [auto1.de] INFO: Saving data for XY68410: {'auction_closing_time': 1774884983.0, 'created_time': 1774521342.185913, 'last_price_update_time': 1774722719.388539}
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY68410') HTTP/1.1" 204 0
2026-03-28 18:31:59 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-28 18:31:59 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-28 18:31:59 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-28 18:31:59 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-28 18:31:59 [auto1.de] INFO: Scrape type for TN32015: 2
2026-03-28 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2620f64c-c64f-53fa-a1ac-a35734abd41e with identifier: TN32015
2026-03-28 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2620f64c-c64f-53fa-a1ac-a35734abd41e with scrape type 2
2026-03-28 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2620f64c-c64f-53fa-a1ac-a35734abd41e with scrape type 2
2026-03-28 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2620f64c-c64f-53fa-a1ac-a35734abd41e, identifier: TN32015
2026-03-28 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2620f64c-c64f-53fa-a1ac-a35734abd41e with identifier: TN32015
2026-03-28 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2620f64c-c64f-53fa-a1ac-a35734abd41e with identifier: TN32015
2026-03-28 18:31:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2620f64c-c64f-53fa-a1ac-a35734abd41e with identifier: TN32015 to the API
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:31:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:27:45Z',
 'fuel_type': 'petrol',
 'id': '2620f64c-c64f-53fa-a1ac-a35734abd41e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN32015',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 142511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-04',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2008}
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32015%27 HTTP/1.1" 200 None
2026-03-28 18:31:59 [auto1.de] INFO: Saving data for TN32015: {'auction_closing_time': 1774884465.0, 'created_time': 1774521394.494748, 'last_price_update_time': 1774722719.832882}
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN32015') HTTP/1.1" 204 0
2026-03-28 18:31:59 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-28 18:31:59 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-28 18:31:59 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ79939%27 HTTP/1.1" 200 None
2026-03-28 18:31:59 [auto1.de] INFO: Scrape type for DZ79939: 0
2026-03-28 18:31:59 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:31:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-28 18:31:59 [auto1.de] INFO: Scrape type for TD17986: 2
2026-03-28 18:31:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2711f656-96eb-5ccd-907e-1719e67a9b84 with identifier: TD17986
2026-03-28 18:31:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2711f656-96eb-5ccd-907e-1719e67a9b84 with scrape type 2
2026-03-28 18:31:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2711f656-96eb-5ccd-907e-1719e67a9b84 with scrape type 2
2026-03-28 18:31:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2711f656-96eb-5ccd-907e-1719e67a9b84, identifier: TD17986
2026-03-28 18:31:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2711f656-96eb-5ccd-907e-1719e67a9b84 with identifier: TD17986
2026-03-28 18:31:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2711f656-96eb-5ccd-907e-1719e67a9b84 with identifier: TD17986
2026-03-28 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2711f656-96eb-5ccd-907e-1719e67a9b84 with identifier: TD17986 to the API
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:40:05Z',
 'fuel_type': 'diesel',
 'id': '2711f656-96eb-5ccd-907e-1719e67a9b84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD17986',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 227011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-26',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2016}
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD17986%27 HTTP/1.1" 200 None
2026-03-28 18:32:00 [auto1.de] INFO: Saving data for TD17986: {'auction_closing_time': 1774885205.0, 'created_time': 1773917363.141979, 'last_price_update_time': 1774722720.282253}
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD17986') HTTP/1.1" 204 0
2026-03-28 18:32:00 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-28 18:32:00 [auto1.de] INFO: Scrape type for DA23811: 2
2026-03-28 18:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with identifier: DA23811
2026-03-28 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with scrape type 2
2026-03-28 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with scrape type 2
2026-03-28 18:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d, identifier: DA23811
2026-03-28 18:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV78740/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with identifier: DA23811
2026-03-28 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with identifier: DA23811
2026-03-28 18:32:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bbad03c-e6a7-571a-930b-d0fbb30fa75d with identifier: DA23811 to the API
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:00:34Z',
 'fuel_type': 'diesel',
 'id': '0bbad03c-e6a7-571a-930b-d0fbb30fa75d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA23811',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 51987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-20',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2015}
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA23811%27 HTTP/1.1" 200 None
2026-03-28 18:32:00 [auto1.de] INFO: Saving data for DA23811: {'auction_closing_time': 1774882834.0, 'created_time': 1774521353.196711, 'last_price_update_time': 1774722720.817959}
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA23811') HTTP/1.1" 204 0
2026-03-28 18:32:00 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-28 18:32:00 [auto1.de] INFO: Scrape type for XS38036: 2
2026-03-28 18:32:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08eadfe0-9686-585b-a307-a4e531045765 with identifier: XS38036
2026-03-28 18:32:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08eadfe0-9686-585b-a307-a4e531045765 with scrape type 2
2026-03-28 18:32:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08eadfe0-9686-585b-a307-a4e531045765 with scrape type 2
2026-03-28 18:32:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08eadfe0-9686-585b-a307-a4e531045765, identifier: XS38036
2026-03-28 18:32:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU25678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08eadfe0-9686-585b-a307-a4e531045765 with identifier: XS38036
2026-03-28 18:32:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08eadfe0-9686-585b-a307-a4e531045765 with identifier: XS38036
2026-03-28 18:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08eadfe0-9686-585b-a307-a4e531045765 with identifier: XS38036 to the API
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:49:11Z',
 'fuel_type': 'petrol',
 'id': '08eadfe0-9686-585b-a307-a4e531045765',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS38036',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 228189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS38036%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Saving data for XS38036: {'auction_closing_time': 1774885751.0, 'created_time': 1774636260.873739, 'last_price_update_time': 1774722721.2608}
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS38036') HTTP/1.1" 204 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS21942%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for AS21942: 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV99753%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for RV99753: 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for DT00101: 2
2026-03-28 18:32:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e298936f-6237-5bd3-a868-667fc475401e with identifier: DT00101
2026-03-28 18:32:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e298936f-6237-5bd3-a868-667fc475401e with scrape type 2
2026-03-28 18:32:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e298936f-6237-5bd3-a868-667fc475401e with scrape type 2
2026-03-28 18:32:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e298936f-6237-5bd3-a868-667fc475401e, identifier: DT00101
2026-03-28 18:32:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e298936f-6237-5bd3-a868-667fc475401e with identifier: DT00101
2026-03-28 18:32:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e298936f-6237-5bd3-a868-667fc475401e with identifier: DT00101
2026-03-28 18:32:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e298936f-6237-5bd3-a868-667fc475401e with identifier: DT00101 to the API
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:21:54Z',
 'fuel_type': 'diesel',
 'id': 'e298936f-6237-5bd3-a868-667fc475401e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT00101',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 305343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-07',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2009}
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00101%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Saving data for DT00101: {'auction_closing_time': 1774884114.0, 'created_time': 1774522463.452967, 'last_price_update_time': 1774722721.763115}
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT00101') HTTP/1.1" 204 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB94614%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for MB94614: 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55483%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for HS55483: 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02307%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for BR02307: 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR26855%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for CR26855: 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP02166%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for VP02166: 0
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-28 18:32:01 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF30572%27 HTTP/1.1" 200 None
2026-03-28 18:32:01 [auto1.de] INFO: Scrape type for DF30572: 0
2026-03-28 18:32:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:02 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ17742%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Scrape type for PJ17742: 0
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Scrape type for RS09713: 2
2026-03-28 18:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b663b392-0663-54b6-8251-3d2b61c84cf3 with identifier: RS09713
2026-03-28 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b663b392-0663-54b6-8251-3d2b61c84cf3 with scrape type 2
2026-03-28 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b663b392-0663-54b6-8251-3d2b61c84cf3 with scrape type 2
2026-03-28 18:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b663b392-0663-54b6-8251-3d2b61c84cf3, identifier: RS09713
2026-03-28 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b663b392-0663-54b6-8251-3d2b61c84cf3 with identifier: RS09713
2026-03-28 18:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b663b392-0663-54b6-8251-3d2b61c84cf3 with identifier: RS09713
2026-03-28 18:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b663b392-0663-54b6-8251-3d2b61c84cf3 with identifier: RS09713 to the API
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:54:11Z',
 'fuel_type': 'petrol',
 'id': 'b663b392-0663-54b6-8251-3d2b61c84cf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS09713',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 125133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-24',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid N-Connecta',
 'transmission': 'automatic',
 'trim': 'N-Connecta',
 'year': 2023}
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS09713%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Saving data for RS09713: {'auction_closing_time': 1774886051.0, 'created_time': 1773467346.031209, 'last_price_update_time': 1774722722.474022}
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS09713') HTTP/1.1" 204 0
2026-03-28 18:32:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK97856%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Scrape type for FK97856: 0
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB89503%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Scrape type for RB89503: 0
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE35464%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Scrape type for HE35464: 0
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN99222%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Scrape type for JN99222: 0
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF02739%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Scrape type for DF02739: 0
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-28 18:32:02 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-28 18:32:02 [auto1.de] INFO: Scrape type for GH93549: 2
2026-03-28 18:32:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with identifier: GH93549
2026-03-28 18:32:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with scrape type 2
2026-03-28 18:32:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with scrape type 2
2026-03-28 18:32:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a, identifier: GH93549
2026-03-28 18:32:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with identifier: GH93549
2026-03-28 18:32:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with identifier: GH93549
2026-03-28 18:32:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a with identifier: GH93549 to the API
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:27Z',
 'fuel_type': 'petrol',
 'id': 'b7319975-e5d2-5ea8-91c0-9a1e2c9dc36a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH93549',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 106907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH93549%27 HTTP/1.1" 200 None
2026-03-28 18:32:03 [auto1.de] INFO: Saving data for GH93549: {'auction_closing_time': 1774885947.0, 'created_time': 1774636280.722115, 'last_price_update_time': 1774722723.105595}
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH93549') HTTP/1.1" 204 0
2026-03-28 18:32:03 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-28 18:32:03 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL06528%27 HTTP/1.1" 200 None
2026-03-28 18:32:03 [auto1.de] INFO: Scrape type for CL06528: 0
2026-03-28 18:32:03 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-28 18:32:03 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-28 18:32:03 [auto1.de] INFO: Scrape type for VK94352: 2
2026-03-28 18:32:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e055a0-8411-5982-bca5-5beda9459b16 with identifier: VK94352
2026-03-28 18:32:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e055a0-8411-5982-bca5-5beda9459b16 with scrape type 2
2026-03-28 18:32:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e055a0-8411-5982-bca5-5beda9459b16 with scrape type 2
2026-03-28 18:32:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4e055a0-8411-5982-bca5-5beda9459b16, identifier: VK94352
2026-03-28 18:32:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4e055a0-8411-5982-bca5-5beda9459b16 with identifier: VK94352
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 18:32:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:32:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4e055a0-8411-5982-bca5-5beda9459b16 with identifier: VK94352
2026-03-28 18:32:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4e055a0-8411-5982-bca5-5beda9459b16 with identifier: VK94352 to the API
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:58:39Z',
 'fuel_type': 'petrol',
 'id': 'b4e055a0-8411-5982-bca5-5beda9459b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK94352',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 175315,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Advance BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion Tech',
 'year': 2018}
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94352%27 HTTP/1.1" 200 None
2026-03-28 18:32:03 [auto1.de] INFO: Saving data for VK94352: {'auction_closing_time': 1774886319.0, 'created_time': 1774521670.370403, 'last_price_update_time': 1774722723.963879}
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK94352') HTTP/1.1" 204 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81277%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for YS81277: 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH61225%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for HH61225: 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC38867%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for UC38867: 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF83806%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for VF83806: 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR64586%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for NR64586: 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG33672%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for TG33672: 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW30112%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for FW30112: 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for GC11605: 2
2026-03-28 18:32:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac8f110e-2aeb-5776-b8ef-84644a035c1d with identifier: GC11605
2026-03-28 18:32:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac8f110e-2aeb-5776-b8ef-84644a035c1d with scrape type 2
2026-03-28 18:32:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac8f110e-2aeb-5776-b8ef-84644a035c1d with scrape type 2
2026-03-28 18:32:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac8f110e-2aeb-5776-b8ef-84644a035c1d, identifier: GC11605
2026-03-28 18:32:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac8f110e-2aeb-5776-b8ef-84644a035c1d with identifier: GC11605
2026-03-28 18:32:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac8f110e-2aeb-5776-b8ef-84644a035c1d with identifier: GC11605
2026-03-28 18:32:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac8f110e-2aeb-5776-b8ef-84644a035c1d with identifier: GC11605 to the API
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:17:22Z',
 'fuel_type': 'petrol',
 'id': 'ac8f110e-2aeb-5776-b8ef-84644a035c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC11605',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 123599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2017}
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC11605%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Saving data for GC11605: {'auction_closing_time': 1774883842.0, 'created_time': 1773399283.621278, 'last_price_update_time': 1774722724.680115}
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC11605') HTTP/1.1" 204 0
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-28 18:32:04 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM53272%27 HTTP/1.1" 200 None
2026-03-28 18:32:04 [auto1.de] INFO: Scrape type for FM53272: 0
2026-03-28 18:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU25678> (referer: https://www.auto1.com/v1/car-details-view/RU25678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV78740> (referer: https://www.auto1.com/v1/car-details-view/KV78740/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccd56610-2cf6-5fce-8962-751341da996f with identifier: RU25678
2026-03-28 18:32:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccd56610-2cf6-5fce-8962-751341da996f with scrape type 1
2026-03-28 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item ccd56610-2cf6-5fce-8962-751341da996f
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71206661a174d1cc7a3785004ce9bc5a%252Fpa%252FRU25678_7e3af470f69c6c6ea4413d48c506487d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_7e3af470f69c6c6ea4413d48c506487d.jpg already downloaded
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71206661a174d1cc7a3785004ce9bc5a%252Fpa%252FRU25678_5e092e9c698b45820bdf31fc6bc120f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_5e092e9c698b45820bdf31fc6bc120f6.jpg already downloaded
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71206661a174d1cc7a3785004ce9bc5a%252Fpa%252FRU25678_3ff10a1b50549283d53fc6aa88a406bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_3ff10a1b50549283d53fc6aa88a406bb.jpg already downloaded
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71206661a174d1cc7a3785004ce9bc5a%252Fpa%252FRU25678_9ae8f7ca5dc016f282ff918f3d1f6484.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_9ae8f7ca5dc016f282ff918f3d1f6484.jpg already downloaded
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71206661a174d1cc7a3785004ce9bc5a%252Fpa%252FRU25678_9fd937e1e9377aba0ec101d8872574bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_9fd937e1e9377aba0ec101d8872574bd.jpg already downloaded
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F20%252F71206661a174d1cc7a3785004ce9bc5a%252Fpa%252FRU25678_8643268d491fecc6e272ddada6f742e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_8643268d491fecc6e272ddada6f742e9.jpg already downloaded
2026-03-28 18:32:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccd56610-2cf6-5fce-8962-751341da996f, identifier: RU25678
2026-03-28 18:32:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccd56610-2cf6-5fce-8962-751341da996f with identifier: RU25678
2026-03-28 18:32:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccd56610-2cf6-5fce-8962-751341da996f with identifier: RU25678
2026-03-28 18:32:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccd56610-2cf6-5fce-8962-751341da996f with identifier: RU25678 to the API
2026-03-28 18:32:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RU25678>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:33:33Z',
 'fuel_type': 'petrol',
 'id': 'ccd56610-2cf6-5fce-8962-751341da996f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU25678',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 236775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_7e3af470f69c6c6ea4413d48c506487d.jpg',
                'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_5e092e9c698b45820bdf31fc6bc120f6.jpg',
                'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_3ff10a1b50549283d53fc6aa88a406bb.jpg',
                'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_9ae8f7ca5dc016f282ff918f3d1f6484.jpg',
                'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_9fd937e1e9377aba0ec101d8872574bd.jpg',
                'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_8643268d491fecc6e272ddada6f742e9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccd56610-2cf6-5fce-8962-751341da996f/ccd56610-2cf6-5fce-8962-751341da996f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_7e3af470f69c6c6ea4413d48c506487d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccd56610-2cf6-5fce-8962-751341da996f/ccd56610-2cf6-5fce-8962-751341da996f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_5e092e9c698b45820bdf31fc6bc120f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccd56610-2cf6-5fce-8962-751341da996f/ccd56610-2cf6-5fce-8962-751341da996f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_3ff10a1b50549283d53fc6aa88a406bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccd56610-2cf6-5fce-8962-751341da996f/ccd56610-2cf6-5fce-8962-751341da996f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_9ae8f7ca5dc016f282ff918f3d1f6484.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccd56610-2cf6-5fce-8962-751341da996f/ccd56610-2cf6-5fce-8962-751341da996f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_9fd937e1e9377aba0ec101d8872574bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ccd56610-2cf6-5fce-8962-751341da996f/ccd56610-2cf6-5fce-8962-751341da996f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/20/71206661a174d1cc7a3785004ce9bc5a/pa/RU25678_8643268d491fecc6e272ddada6f742e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU25678%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Saving data for RU25678: {'created_time': 1774722726.219926, 'last_price_update_time': 1774722726.219939, 'auction_closing_time': 1774884813.0}
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU25678') HTTP/1.1" 204 0
2026-03-28 18:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89593bb7-81d9-5f50-8c54-4603b80d6dad with identifier: KV78740
2026-03-28 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89593bb7-81d9-5f50-8c54-4603b80d6dad with scrape type 1
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89593bb7-81d9-5f50-8c54-4603b80d6dad
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_8ecec92e942327e34f9911e7ee6f7c94.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_8ecec92e942327e34f9911e7ee6f7c94.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_8d0d24f7c46d31157368a3f9008224ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_8d0d24f7c46d31157368a3f9008224ef.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_a784e47091aec2ebcdc9b2401683d270.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_a784e47091aec2ebcdc9b2401683d270.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_fdfdf36f48831db58807e8ed0c501363.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_fdfdf36f48831db58807e8ed0c501363.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_c4d253ad3485c7c033837d98bcb13aad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_c4d253ad3485c7c033837d98bcb13aad.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_3365629b7b5650ce1f56ac5f94129479.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_3365629b7b5650ce1f56ac5f94129479.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_4a20f6ac462ce7ab64301362ba9c544f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_4a20f6ac462ce7ab64301362ba9c544f.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_b9580f37e6c595fedca18c55393ec1d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_b9580f37e6c595fedca18c55393ec1d7.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_be66b16073d711faabb423a6639778db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_be66b16073d711faabb423a6639778db.jpg already downloaded
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F9f%252F259f22b6d652017bb9517a95becc7a72%252Fpa%252FKV78740_05a61e2c2e26c31e3263dbc316e80854.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_05a61e2c2e26c31e3263dbc316e80854.jpg already downloaded
2026-03-28 18:32:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89593bb7-81d9-5f50-8c54-4603b80d6dad, identifier: KV78740
2026-03-28 18:32:06 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89593bb7-81d9-5f50-8c54-4603b80d6dad with identifier: KV78740
2026-03-28 18:32:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89593bb7-81d9-5f50-8c54-4603b80d6dad with identifier: KV78740
2026-03-28 18:32:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89593bb7-81d9-5f50-8c54-4603b80d6dad with identifier: KV78740 to the API
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KV78740>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:44:46Z',
 'fuel_type': 'petrol',
 'id': '89593bb7-81d9-5f50-8c54-4603b80d6dad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV78740',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Volkswagen',
 'model': 'CC',
 'odometer': 159314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_8ecec92e942327e34f9911e7ee6f7c94.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_8d0d24f7c46d31157368a3f9008224ef.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_a784e47091aec2ebcdc9b2401683d270.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_fdfdf36f48831db58807e8ed0c501363.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_c4d253ad3485c7c033837d98bcb13aad.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_3365629b7b5650ce1f56ac5f94129479.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_4a20f6ac462ce7ab64301362ba9c544f.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_b9580f37e6c595fedca18c55393ec1d7.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_be66b16073d711faabb423a6639778db.jpg',
                'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_05a61e2c2e26c31e3263dbc316e80854.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_8ecec92e942327e34f9911e7ee6f7c94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_8d0d24f7c46d31157368a3f9008224ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64154,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_a784e47091aec2ebcdc9b2401683d270.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_fdfdf36f48831db58807e8ed0c501363.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_c4d253ad3485c7c033837d98bcb13aad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_3365629b7b5650ce1f56ac5f94129479.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_4a20f6ac462ce7ab64301362ba9c544f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_b9580f37e6c595fedca18c55393ec1d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_be66b16073d711faabb423a6639778db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89593bb7-81d9-5f50-8c54-4603b80d6dad/89593bb7-81d9-5f50-8c54-4603b80d6dad_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/9f/259f22b6d652017bb9517a95becc7a72/pa/KV78740_05a61e2c2e26c31e3263dbc316e80854.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen CC 2.0 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV78740%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Saving data for KV78740: {'created_time': 1774722726.846903, 'last_price_update_time': 1774722726.846915, 'auction_closing_time': 1774885486.0}
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV78740') HTTP/1.1" 204 0
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB72145%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Scrape type for HB72145: 0
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL70410%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Scrape type for UL70410: 0
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL41666%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Scrape type for UL41666: 0
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL23601%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Scrape type for RL23601: 0
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ81937%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Scrape type for UZ81937: 0
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB33579%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Scrape type for EB33579: 0
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ05535%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Scrape type for AZ05535: 0
2026-03-28 18:32:06 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-28 18:32:06 [auto1.de] INFO: Scrape type for DW36097: 2
2026-03-28 18:32:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a281040-da86-50a7-815d-0e5fff86f0fb with identifier: DW36097
2026-03-28 18:32:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a281040-da86-50a7-815d-0e5fff86f0fb with scrape type 2
2026-03-28 18:32:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a281040-da86-50a7-815d-0e5fff86f0fb with scrape type 2
2026-03-28 18:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a281040-da86-50a7-815d-0e5fff86f0fb, identifier: DW36097
2026-03-28 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a281040-da86-50a7-815d-0e5fff86f0fb with identifier: DW36097
2026-03-28 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a281040-da86-50a7-815d-0e5fff86f0fb with identifier: DW36097
2026-03-28 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a281040-da86-50a7-815d-0e5fff86f0fb with identifier: DW36097 to the API
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:01Z',
 'fuel_type': 'petrol',
 'id': '5a281040-da86-50a7-815d-0e5fff86f0fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW36097',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 101639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-06',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Brabus style',
 'transmission': 'automatic',
 'trim': 'Brabus style',
 'year': 2019}
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW36097%27 HTTP/1.1" 200 None
2026-03-28 18:32:07 [auto1.de] INFO: Saving data for DW36097: {'auction_closing_time': 1774883641.0, 'created_time': 1774349500.350283, 'last_price_update_time': 1774722727.40444}
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW36097') HTTP/1.1" 204 0
2026-03-28 18:32:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:07 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC22222%27 HTTP/1.1" 200 None
2026-03-28 18:32:07 [auto1.de] INFO: Scrape type for MC22222: 0
2026-03-28 18:32:07 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-28 18:32:07 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-28 18:32:07 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-28 18:32:07 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-28 18:32:07 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-28 18:32:07 [auto1.de] INFO: Scrape type for UB34830: 2
2026-03-28 18:32:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bc5625e-acc6-58d6-a85c-f70607b7c495 with identifier: UB34830
2026-03-28 18:32:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bc5625e-acc6-58d6-a85c-f70607b7c495 with scrape type 2
2026-03-28 18:32:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bc5625e-acc6-58d6-a85c-f70607b7c495 with scrape type 2
2026-03-28 18:32:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bc5625e-acc6-58d6-a85c-f70607b7c495, identifier: UB34830
2026-03-28 18:32:07 [scrapy.extensions.logstats] INFO: Crawled 65 pages (at 31 pages/min), scraped 132 items (at 61 items/min)
2026-03-28 18:32:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-28 18:32:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bc5625e-acc6-58d6-a85c-f70607b7c495 with identifier: UB34830
2026-03-28 18:32:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bc5625e-acc6-58d6-a85c-f70607b7c495 with identifier: UB34830
2026-03-28 18:32:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bc5625e-acc6-58d6-a85c-f70607b7c495 with identifier: UB34830 to the API
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:52:40Z',
 'fuel_type': 'diesel',
 'id': '2bc5625e-acc6-58d6-a85c-f70607b7c495',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB34830',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 254765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-08',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 420 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB34830%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Saving data for UB34830: {'auction_closing_time': 1774885960.0, 'created_time': 1773467361.926633, 'last_price_update_time': 1774722728.016187}
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB34830') HTTP/1.1" 204 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH94786%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Scrape type for FH94786: 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF48046%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Scrape type for YF48046: 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH13363%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Scrape type for DH13363: 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN18911%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Scrape type for RN18911: 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX26949%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Scrape type for KX26949: 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW82123%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Scrape type for VW82123: 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ95706%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Scrape type for JJ95706: 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD89889%27 HTTP/1.1" 200 None
2026-03-28 18:32:08 [auto1.de] INFO: Scrape type for DD89889: 0
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-28 18:32:08 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-28 18:32:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:09 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:09 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-28 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT74985%27 HTTP/1.1" 200 None
2026-03-28 18:32:09 [auto1.de] INFO: Scrape type for CT74985: 0
2026-03-28 18:32:09 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-28 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-28 18:32:09 [auto1.de] INFO: Scrape type for UA36533: 2
2026-03-28 18:32:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 262afb25-414d-5fd8-999f-a8f3c67e93a3 with identifier: UA36533
2026-03-28 18:32:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 262afb25-414d-5fd8-999f-a8f3c67e93a3 with scrape type 2
2026-03-28 18:32:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 262afb25-414d-5fd8-999f-a8f3c67e93a3 with scrape type 2
2026-03-28 18:32:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 262afb25-414d-5fd8-999f-a8f3c67e93a3, identifier: UA36533
2026-03-28 18:32:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 262afb25-414d-5fd8-999f-a8f3c67e93a3 with identifier: UA36533
2026-03-28 18:32:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 262afb25-414d-5fd8-999f-a8f3c67e93a3 with identifier: UA36533
2026-03-28 18:32:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 262afb25-414d-5fd8-999f-a8f3c67e93a3 with identifier: UA36533 to the API
2026-03-28 18:32:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:07:20Z',
 'fuel_type': 'diesel',
 'id': '262afb25-414d-5fd8-999f-a8f3c67e93a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA36533',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 155935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2015}
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA36533%27 HTTP/1.1" 200 None
2026-03-28 18:32:10 [auto1.de] INFO: Saving data for UA36533: {'auction_closing_time': 1774883240.0, 'created_time': 1774522610.008199, 'last_price_update_time': 1774722730.471963}
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA36533') HTTP/1.1" 204 0
2026-03-28 18:32:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:10 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX51342%27 HTTP/1.1" 200 None
2026-03-28 18:32:10 [auto1.de] INFO: Scrape type for AX51342: 0
2026-03-28 18:32:10 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ71992%27 HTTP/1.1" 200 None
2026-03-28 18:32:10 [auto1.de] INFO: Scrape type for YJ71992: 0
2026-03-28 18:32:10 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-28 18:32:10 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG56142%27 HTTP/1.1" 200 None
2026-03-28 18:32:10 [auto1.de] INFO: Scrape type for SG56142: 0
2026-03-28 18:32:10 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB82704%27 HTTP/1.1" 200 None
2026-03-28 18:32:10 [auto1.de] INFO: Scrape type for TB82704: 0
2026-03-28 18:32:10 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-28 18:32:10 [auto1.de] INFO: Scrape type for XN70423: 2
2026-03-28 18:32:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with identifier: XN70423
2026-03-28 18:32:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with scrape type 2
2026-03-28 18:32:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with scrape type 2
2026-03-28 18:32:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4611e11-93ac-5b5c-8a86-b0634b25d7d6, identifier: XN70423
2026-03-28 18:32:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with identifier: XN70423
2026-03-28 18:32:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with identifier: XN70423
2026-03-28 18:32:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4611e11-93ac-5b5c-8a86-b0634b25d7d6 with identifier: XN70423 to the API
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:14Z',
 'fuel_type': 'petrol',
 'id': 'd4611e11-93ac-5b5c-8a86-b0634b25d7d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN70423',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 87255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-29',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2019}
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN70423%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Saving data for XN70423: {'auction_closing_time': 1774884674.0, 'created_time': 1774034339.346719, 'last_price_update_time': 1774722731.07166}
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN70423') HTTP/1.1" 204 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC56914%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for JC56914: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG55778%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for VG55778: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD21016%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for LD21016: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA09921%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for PA09921: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD73380%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for AD73380: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ57142%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for EJ57142: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC19539%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for ZC19539: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for FG50189: 2
2026-03-28 18:32:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 578472b3-85db-559f-8d5f-4c447ffba9ce with identifier: FG50189
2026-03-28 18:32:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 578472b3-85db-559f-8d5f-4c447ffba9ce with scrape type 2
2026-03-28 18:32:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 578472b3-85db-559f-8d5f-4c447ffba9ce with scrape type 2
2026-03-28 18:32:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 578472b3-85db-559f-8d5f-4c447ffba9ce, identifier: FG50189
2026-03-28 18:32:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 578472b3-85db-559f-8d5f-4c447ffba9ce with identifier: FG50189
2026-03-28 18:32:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 578472b3-85db-559f-8d5f-4c447ffba9ce with identifier: FG50189
2026-03-28 18:32:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 578472b3-85db-559f-8d5f-4c447ffba9ce with identifier: FG50189 to the API
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:21:16Z',
 'fuel_type': 'petrol',
 'id': '578472b3-85db-559f-8d5f-4c447ffba9ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG50189',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 175984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-02',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Inform',
 'transmission': 'manual',
 'trim': 'Inform',
 'year': 2009}
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG50189%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Saving data for FG50189: {'auction_closing_time': 1774884076.0, 'created_time': 1774521618.098945, 'last_price_update_time': 1774722731.648581}
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG50189') HTTP/1.1" 204 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA19141%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for ZA19141: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU60385%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for BU60385: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK35059%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for MK35059: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM51620%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for VM51620: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ04835%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for WJ04835: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88606%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for PY88606: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP15297%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for GP15297: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40951%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for TX40951: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU16541%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for BU16541: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA67695%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for EA67695: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA41049%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for MA41049: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV25336%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for AV25336: 0
2026-03-28 18:32:11 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG86685%27 HTTP/1.1" 200 None
2026-03-28 18:32:11 [auto1.de] INFO: Scrape type for BG86685: 0
2026-03-28 18:32:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:12 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:12 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-28 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER78775%27 HTTP/1.1" 200 None
2026-03-28 18:32:12 [auto1.de] INFO: Scrape type for ER78775: 0
2026-03-28 18:32:12 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-28 18:32:12 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-28 18:32:12 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-28 18:32:12 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-28 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-28 18:32:12 [auto1.de] INFO: Scrape type for LA66980: 2
2026-03-28 18:32:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with identifier: LA66980
2026-03-28 18:32:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with scrape type 2
2026-03-28 18:32:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with scrape type 2
2026-03-28 18:32:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa, identifier: LA66980
2026-03-28 18:32:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with identifier: LA66980
2026-03-28 18:32:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with identifier: LA66980
2026-03-28 18:32:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa with identifier: LA66980 to the API
2026-03-28 18:32:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:53:59Z',
 'fuel_type': 'diesel',
 'id': 'c5a3dbb6-3480-5cfb-a0e7-064b61e4b9fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA66980',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 206965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI BlueTEC',
 'transmission': 'automatic',
 'trim': 'BlueTEC',
 'year': 2015}
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA66980%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Saving data for LA66980: {'auction_closing_time': 1774886039.0, 'created_time': 1773467604.651753, 'last_price_update_time': 1774722733.193861}
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA66980') HTTP/1.1" 204 0
2026-03-28 18:32:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM25044%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for TM25044: 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT09542%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for LT09542: 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW55395%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for ZW55395: 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY61993%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for VY61993: 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU33695%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for MU33695: 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV04533%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for LV04533: 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for RY91957: 2
2026-03-28 18:32:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with identifier: RY91957
2026-03-28 18:32:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with scrape type 2
2026-03-28 18:32:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with scrape type 2
2026-03-28 18:32:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe, identifier: RY91957
2026-03-28 18:32:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with identifier: RY91957
2026-03-28 18:32:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with identifier: RY91957
2026-03-28 18:32:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3bad3051-6dc0-5c54-8793-8e98ae8be6fe with identifier: RY91957 to the API
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:24:32Z',
 'fuel_type': 'diesel',
 'id': '3bad3051-6dc0-5c54-8793-8e98ae8be6fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY91957',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 17013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-29',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi EcoBlue Wildtrak e-4WD Doppelkabine',
 'transmission': 'automatic',
 'trim': 'Wildtrak e-4WD Doppelkabine',
 'year': 2023}
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY91957%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Saving data for RY91957: {'auction_closing_time': 1774884272.0, 'created_time': 1774636295.262243, 'last_price_update_time': 1774722733.83915}
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY91957') HTTP/1.1" 204 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ54097%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for HJ54097: 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10430%27 HTTP/1.1" 200 None
2026-03-28 18:32:13 [auto1.de] INFO: Scrape type for HA10430: 0
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-28 18:32:13 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-28 18:32:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG08192%27 HTTP/1.1" 200 None
2026-03-28 18:32:14 [auto1.de] INFO: Scrape type for KG08192: 0
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX24804%27 HTTP/1.1" 200 None
2026-03-28 18:32:14 [auto1.de] INFO: Scrape type for DX24804: 0
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL07101%27 HTTP/1.1" 200 None
2026-03-28 18:32:14 [auto1.de] INFO: Scrape type for GL07101: 0
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-28 18:32:14 [auto1.de] INFO: Scrape type for TE32041: 2
2026-03-28 18:32:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with identifier: TE32041
2026-03-28 18:32:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with scrape type 2
2026-03-28 18:32:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with scrape type 2
2026-03-28 18:32:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39ee2a34-aa5f-551c-8601-a0949aa96fa4, identifier: TE32041
2026-03-28 18:32:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with identifier: TE32041
2026-03-28 18:32:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with identifier: TE32041
2026-03-28 18:32:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39ee2a34-aa5f-551c-8601-a0949aa96fa4 with identifier: TE32041 to the API
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:59:59Z',
 'fuel_type': 'petrol',
 'id': '39ee2a34-aa5f-551c-8601-a0949aa96fa4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE32041',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 74299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-26',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2017}
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE32041%27 HTTP/1.1" 200 None
2026-03-28 18:32:14 [auto1.de] INFO: Saving data for TE32041: {'auction_closing_time': 1774886399.0, 'created_time': 1774032633.711144, 'last_price_update_time': 1774722734.476559}
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE32041') HTTP/1.1" 204 0
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX34455%27 HTTP/1.1" 200 None
2026-03-28 18:32:14 [auto1.de] INFO: Scrape type for HX34455: 0
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG72803%27 HTTP/1.1" 200 None
2026-03-28 18:32:14 [auto1.de] INFO: Scrape type for YG72803: 0
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-28 18:32:14 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00306%27 HTTP/1.1" 200 None
2026-03-28 18:32:14 [auto1.de] INFO: Scrape type for HX00306: 0
2026-03-28 18:32:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:15 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:15 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-28 18:32:15 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR62221%27 HTTP/1.1" 200 None
2026-03-28 18:32:15 [auto1.de] INFO: Scrape type for AR62221: 0
2026-03-28 18:32:15 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-28 18:32:15 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-28 18:32:15 [auto1.de] INFO: Scrape type for CY90259: 2
2026-03-28 18:32:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-03-28 18:32:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de58bf4-698d-517a-9c72-9c06f59c3952 with scrape type 2
2026-03-28 18:32:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2de58bf4-698d-517a-9c72-9c06f59c3952 with scrape type 2
2026-03-28 18:32:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de58bf4-698d-517a-9c72-9c06f59c3952, identifier: CY90259
2026-03-28 18:32:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-03-28 18:32:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259
2026-03-28 18:32:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de58bf4-698d-517a-9c72-9c06f59c3952 with identifier: CY90259 to the API
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:56:02Z',
 'fuel_type': 'diesel',
 'id': '2de58bf4-698d-517a-9c72-9c06f59c3952',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY90259',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 105578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-22',
 'seller_name': None,
 'title': 'Audi A4 40 TDI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2020}
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY90259%27 HTTP/1.1" 200 None
2026-03-28 18:32:15 [auto1.de] INFO: Saving data for CY90259: {'auction_closing_time': 1774886162.0, 'created_time': 1774521435.043874, 'last_price_update_time': 1774722735.963929}
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY90259') HTTP/1.1" 204 0
2026-03-28 18:32:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:15 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-28 18:32:15 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-28 18:32:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY14877%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for BY14877: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV93240%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for AV93240: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ09697%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for BZ09697: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for GC82813: 2
2026-03-28 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with identifier: GC82813
2026-03-28 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with scrape type 2
2026-03-28 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with scrape type 2
2026-03-28 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a, identifier: GC82813
2026-03-28 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with identifier: GC82813
2026-03-28 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with identifier: GC82813
2026-03-28 18:32:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 992cb1ee-f75f-53eb-b3d1-04018cb38e3a with identifier: GC82813 to the API
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:23Z',
 'fuel_type': 'petrol',
 'id': '992cb1ee-f75f-53eb-b3d1-04018cb38e3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC82813',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 64001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-24',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 4x4',
 'transmission': 'automatic',
 'trim': '4x4',
 'year': 2005}
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC82813%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Saving data for GC82813: {'auction_closing_time': 1774885403.0, 'created_time': 1773830247.659399, 'last_price_update_time': 1774722736.488252}
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC82813') HTTP/1.1" 204 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND33880%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for ND33880: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE28071%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for GE28071: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB26225%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for AB26225: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL23541%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for PL23541: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC70285%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for SC70285: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX62858%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for FX62858: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB46016%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for XB46016: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX34768%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for BX34768: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF74386%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for CF74386: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG17958%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for CG17958: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF25460%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for YF25460: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG09102%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for FG09102: 0
2026-03-28 18:32:16 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-28 18:32:16 [auto1.de] INFO: Scrape type for UT25770: 2
2026-03-28 18:32:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6aa6d5c-3457-51f1-8480-a5784e581506 with identifier: UT25770
2026-03-28 18:32:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6aa6d5c-3457-51f1-8480-a5784e581506 with scrape type 2
2026-03-28 18:32:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6aa6d5c-3457-51f1-8480-a5784e581506 with scrape type 2
2026-03-28 18:32:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6aa6d5c-3457-51f1-8480-a5784e581506, identifier: UT25770
2026-03-28 18:32:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6aa6d5c-3457-51f1-8480-a5784e581506 with identifier: UT25770
2026-03-28 18:32:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6aa6d5c-3457-51f1-8480-a5784e581506 with identifier: UT25770
2026-03-28 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6aa6d5c-3457-51f1-8480-a5784e581506 with identifier: UT25770 to the API
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:04:17Z',
 'fuel_type': 'diesel',
 'id': 'd6aa6d5c-3457-51f1-8480-a5784e581506',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT25770',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 111903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-03',
 'seller_name': None,
 'title': 'BMW 3er 330d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT25770%27 HTTP/1.1" 200 None
2026-03-28 18:32:17 [auto1.de] INFO: Saving data for UT25770: {'auction_closing_time': 1774883057.0, 'created_time': 1774636301.317554, 'last_price_update_time': 1774722737.226011}
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT25770') HTTP/1.1" 204 0
2026-03-28 18:32:17 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ55573%27 HTTP/1.1" 200 None
2026-03-28 18:32:17 [auto1.de] INFO: Scrape type for KJ55573: 0
2026-03-28 18:32:17 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-28 18:32:17 [auto1.de] INFO: Scrape type for YD46257: 2
2026-03-28 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 386cff13-9da0-52da-af4a-50c32cd3b172 with identifier: YD46257
2026-03-28 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 386cff13-9da0-52da-af4a-50c32cd3b172 with scrape type 2
2026-03-28 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 386cff13-9da0-52da-af4a-50c32cd3b172 with scrape type 2
2026-03-28 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 386cff13-9da0-52da-af4a-50c32cd3b172, identifier: YD46257
2026-03-28 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 386cff13-9da0-52da-af4a-50c32cd3b172 with identifier: YD46257
2026-03-28 18:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 386cff13-9da0-52da-af4a-50c32cd3b172 with identifier: YD46257
2026-03-28 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 386cff13-9da0-52da-af4a-50c32cd3b172 with identifier: YD46257 to the API
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:45:13Z',
 'fuel_type': 'petrol',
 'id': '386cff13-9da0-52da-af4a-50c32cd3b172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD46257',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 26632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-25',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2023}
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD46257%27 HTTP/1.1" 200 None
2026-03-28 18:32:17 [auto1.de] INFO: Saving data for YD46257: {'auction_closing_time': 1774885513.0, 'created_time': 1774521795.939227, 'last_price_update_time': 1774722737.772764}
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD46257') HTTP/1.1" 204 0
2026-03-28 18:32:17 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-28 18:32:17 [auto1.de] INFO: Scrape type for KE90255: 2
2026-03-28 18:32:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 010ebf66-8f9b-5507-b009-10645d8d5d95 with identifier: KE90255
2026-03-28 18:32:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 010ebf66-8f9b-5507-b009-10645d8d5d95 with scrape type 2
2026-03-28 18:32:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 010ebf66-8f9b-5507-b009-10645d8d5d95 with scrape type 2
2026-03-28 18:32:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 010ebf66-8f9b-5507-b009-10645d8d5d95, identifier: KE90255
2026-03-28 18:32:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 010ebf66-8f9b-5507-b009-10645d8d5d95 with identifier: KE90255
2026-03-28 18:32:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 010ebf66-8f9b-5507-b009-10645d8d5d95 with identifier: KE90255
2026-03-28 18:32:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 010ebf66-8f9b-5507-b009-10645d8d5d95 with identifier: KE90255 to the API
2026-03-28 18:32:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:27:19Z',
 'fuel_type': 'petrol',
 'id': '010ebf66-8f9b-5507-b009-10645d8d5d95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE90255',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 201062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-20',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Platinum',
 'transmission': 'automatic',
 'trim': 'Platinum',
 'year': 2015}
2026-03-28 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90255%27 HTTP/1.1" 200 None
2026-03-28 18:32:18 [auto1.de] INFO: Saving data for KE90255: {'auction_closing_time': 1774884439.0, 'created_time': 1774521639.262795, 'last_price_update_time': 1774722738.220013}
2026-03-28 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE90255') HTTP/1.1" 204 0
2026-03-28 18:32:18 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-28 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ72052%27 HTTP/1.1" 200 None
2026-03-28 18:32:18 [auto1.de] INFO: Scrape type for GJ72052: 0
2026-03-28 18:32:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:19 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK87583%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for XK87583: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP89370%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for RP89370: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA14554%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for TA14554: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB28845%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for DB28845: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG30420%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for PG30420: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX76120%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for FX76120: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF84610%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for UF84610: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA07254%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for VA07254: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for NW39371: 2
2026-03-28 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f22e3e5a-10a3-5421-a506-edf88de556c6 with identifier: NW39371
2026-03-28 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f22e3e5a-10a3-5421-a506-edf88de556c6 with scrape type 2
2026-03-28 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f22e3e5a-10a3-5421-a506-edf88de556c6 with scrape type 2
2026-03-28 18:32:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f22e3e5a-10a3-5421-a506-edf88de556c6, identifier: NW39371
2026-03-28 18:32:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f22e3e5a-10a3-5421-a506-edf88de556c6 with identifier: NW39371
2026-03-28 18:32:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f22e3e5a-10a3-5421-a506-edf88de556c6 with identifier: NW39371
2026-03-28 18:32:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f22e3e5a-10a3-5421-a506-edf88de556c6 with identifier: NW39371 to the API
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:46:19Z',
 'fuel_type': 'petrol',
 'id': 'f22e3e5a-10a3-5421-a506-edf88de556c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW39371',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 389440,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW39371%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Saving data for NW39371: {'auction_closing_time': 1774885579.0, 'created_time': 1773466929.653275, 'last_price_update_time': 1774722739.792528}
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW39371') HTTP/1.1" 204 0
2026-03-28 18:32:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR95231%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for BR95231: 0
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-28 18:32:19 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-28 18:32:19 [auto1.de] INFO: Scrape type for BY42207: 2
2026-03-28 18:32:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96745c70-3014-551d-951f-3b074df8859f with identifier: BY42207
2026-03-28 18:32:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96745c70-3014-551d-951f-3b074df8859f with scrape type 2
2026-03-28 18:32:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96745c70-3014-551d-951f-3b074df8859f with scrape type 2
2026-03-28 18:32:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96745c70-3014-551d-951f-3b074df8859f, identifier: BY42207
2026-03-28 18:32:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96745c70-3014-551d-951f-3b074df8859f with identifier: BY42207
2026-03-28 18:32:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96745c70-3014-551d-951f-3b074df8859f with identifier: BY42207
2026-03-28 18:32:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96745c70-3014-551d-951f-3b074df8859f with identifier: BY42207 to the API
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:12:20Z',
 'fuel_type': 'petrol',
 'id': '96745c70-3014-551d-951f-3b074df8859f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY42207',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 48787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-26',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Basis 2WD',
 'transmission': 'manual',
 'trim': 'Basis 2WD',
 'year': 2018}
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY42207%27 HTTP/1.1" 200 None
2026-03-28 18:32:20 [auto1.de] INFO: Saving data for BY42207: {'auction_closing_time': 1774883540.0, 'created_time': 1773466963.286455, 'last_price_update_time': 1774722740.417652}
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY42207') HTTP/1.1" 204 0
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT60095%27 HTTP/1.1" 200 None
2026-03-28 18:32:20 [auto1.de] INFO: Scrape type for WT60095: 0
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC65519%27 HTTP/1.1" 200 None
2026-03-28 18:32:20 [auto1.de] INFO: Scrape type for NC65519: 0
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT20326%27 HTTP/1.1" 200 None
2026-03-28 18:32:20 [auto1.de] INFO: Scrape type for ZT20326: 0
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ20287%27 HTTP/1.1" 200 None
2026-03-28 18:32:20 [auto1.de] INFO: Scrape type for HZ20287: 0
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD11027%27 HTTP/1.1" 200 None
2026-03-28 18:32:20 [auto1.de] INFO: Scrape type for MD11027: 0
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE80218%27 HTTP/1.1" 200 None
2026-03-28 18:32:20 [auto1.de] INFO: Scrape type for VE80218: 0
2026-03-28 18:32:20 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT47109%27 HTTP/1.1" 200 None
2026-03-28 18:32:20 [auto1.de] INFO: Scrape type for LT47109: 0
2026-03-28 18:32:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:21 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU20206%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for FU20206: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH04581%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for RH04581: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR62368%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for HR62368: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT27360%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for RT27360: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD11713%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for XD11713: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA34642%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for CA34642: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW35011%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for NW35011: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF78107%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for GF78107: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW84966%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for JW84966: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP50374%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for RP50374: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG74532%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for CG74532: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD86365%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for SD86365: 0
2026-03-28 18:32:21 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Scrape type for SM47095: 2
2026-03-28 18:32:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f863274d-1687-5436-b2f5-3ca064a057e2 with identifier: SM47095
2026-03-28 18:32:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f863274d-1687-5436-b2f5-3ca064a057e2 with scrape type 2
2026-03-28 18:32:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f863274d-1687-5436-b2f5-3ca064a057e2 with scrape type 2
2026-03-28 18:32:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f863274d-1687-5436-b2f5-3ca064a057e2, identifier: SM47095
2026-03-28 18:32:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f863274d-1687-5436-b2f5-3ca064a057e2 with identifier: SM47095
2026-03-28 18:32:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f863274d-1687-5436-b2f5-3ca064a057e2 with identifier: SM47095
2026-03-28 18:32:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f863274d-1687-5436-b2f5-3ca064a057e2 with identifier: SM47095 to the API
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:23Z',
 'fuel_type': 'petrol',
 'id': 'f863274d-1687-5436-b2f5-3ca064a057e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM47095',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 131250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-21',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM47095%27 HTTP/1.1" 200 None
2026-03-28 18:32:21 [auto1.de] INFO: Saving data for SM47095: {'auction_closing_time': 1774882823.0, 'created_time': 1774521258.134441, 'last_price_update_time': 1774722741.930532}
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM47095') HTTP/1.1" 204 0
2026-03-28 18:32:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG31591%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for RG31591: 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ48596%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for SZ48596: 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE46941%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for YE46941: 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for WM09546: 2
2026-03-28 18:32:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 563c1543-2196-5caa-bcd8-61959bb74a5e with identifier: WM09546
2026-03-28 18:32:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563c1543-2196-5caa-bcd8-61959bb74a5e with scrape type 2
2026-03-28 18:32:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 563c1543-2196-5caa-bcd8-61959bb74a5e with scrape type 2
2026-03-28 18:32:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 563c1543-2196-5caa-bcd8-61959bb74a5e, identifier: WM09546
2026-03-28 18:32:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 563c1543-2196-5caa-bcd8-61959bb74a5e with identifier: WM09546
2026-03-28 18:32:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 563c1543-2196-5caa-bcd8-61959bb74a5e with identifier: WM09546
2026-03-28 18:32:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 563c1543-2196-5caa-bcd8-61959bb74a5e with identifier: WM09546 to the API
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:22:20Z',
 'fuel_type': 'petrol',
 'id': '563c1543-2196-5caa-bcd8-61959bb74a5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM09546',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 182200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-31',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.6 FSI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2006}
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM09546%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Saving data for WM09546: {'auction_closing_time': 1774884140.0, 'created_time': 1774118848.537404, 'last_price_update_time': 1774722742.538716}
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM09546') HTTP/1.1" 204 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR11811%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for BR11811: 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ62462%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for GJ62462: 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS71504%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for DS71504: 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG41390%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for WG41390: 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC00063%27 HTTP/1.1" 200 None
2026-03-28 18:32:22 [auto1.de] INFO: Scrape type for SC00063: 0
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-28 18:32:22 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-28 18:32:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:23 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:23 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY64526%27 HTTP/1.1" 200 None
2026-03-28 18:32:23 [auto1.de] INFO: Scrape type for FY64526: 0
2026-03-28 18:32:23 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE79254%27 HTTP/1.1" 200 None
2026-03-28 18:32:23 [auto1.de] INFO: Scrape type for WE79254: 0
2026-03-28 18:32:23 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT28952%27 HTTP/1.1" 200 None
2026-03-28 18:32:23 [auto1.de] INFO: Scrape type for MT28952: 0
2026-03-28 18:32:23 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK84600%27 HTTP/1.1" 200 None
2026-03-28 18:32:23 [auto1.de] INFO: Scrape type for NK84600: 0
2026-03-28 18:32:23 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-28 18:32:23 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-28 18:32:23 [auto1.de] INFO: Scrape type for TY75534: 2
2026-03-28 18:32:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc4b0dca-f543-520e-9f8b-7bd77b15d21b with identifier: TY75534
2026-03-28 18:32:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc4b0dca-f543-520e-9f8b-7bd77b15d21b with scrape type 2
2026-03-28 18:32:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc4b0dca-f543-520e-9f8b-7bd77b15d21b with scrape type 2
2026-03-28 18:32:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc4b0dca-f543-520e-9f8b-7bd77b15d21b, identifier: TY75534
2026-03-28 18:32:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc4b0dca-f543-520e-9f8b-7bd77b15d21b with identifier: TY75534
2026-03-28 18:32:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc4b0dca-f543-520e-9f8b-7bd77b15d21b with identifier: TY75534
2026-03-28 18:32:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc4b0dca-f543-520e-9f8b-7bd77b15d21b with identifier: TY75534 to the API
2026-03-28 18:32:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:01:18Z',
 'fuel_type': 'diesel',
 'id': 'dc4b0dca-f543-520e-9f8b-7bd77b15d21b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY75534',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 164537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-03',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2013}
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY75534%27 HTTP/1.1" 200 None
2026-03-28 18:32:24 [auto1.de] INFO: Saving data for TY75534: {'auction_closing_time': 1774882878.0, 'created_time': 1774521872.122957, 'last_price_update_time': 1774722744.125194}
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY75534') HTTP/1.1" 204 0
2026-03-28 18:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16808%27 HTTP/1.1" 200 None
2026-03-28 18:32:24 [auto1.de] INFO: Scrape type for YT16808: 0
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-28 18:32:24 [auto1.de] INFO: Scrape type for AW88722: 1
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB95370%27 HTTP/1.1" 200 None
2026-03-28 18:32:24 [auto1.de] INFO: Scrape type for JB95370: 0
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ19484%27 HTTP/1.1" 200 None
2026-03-28 18:32:24 [auto1.de] INFO: Scrape type for ZJ19484: 0
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-28 18:32:24 [auto1.de] INFO: Scrape type for AP34925: 2
2026-03-28 18:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with identifier: AP34925
2026-03-28 18:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with scrape type 2
2026-03-28 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with scrape type 2
2026-03-28 18:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822, identifier: AP34925
2026-03-28 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with identifier: AP34925
2026-03-28 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with identifier: AP34925
2026-03-28 18:32:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fcf05dc-b68f-5cc9-8a4f-78176e97c822 with identifier: AP34925 to the API
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:35:11Z',
 'fuel_type': 'diesel',
 'id': '8fcf05dc-b68f-5cc9-8a4f-78176e97c822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP34925',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 284261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP34925%27 HTTP/1.1" 200 None
2026-03-28 18:32:24 [auto1.de] INFO: Saving data for AP34925: {'auction_closing_time': 1774884911.0, 'created_time': 1774522363.001254, 'last_price_update_time': 1774722744.801079}
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP34925') HTTP/1.1" 204 0
2026-03-28 18:32:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:24 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-28 18:32:24 [auto1.de] INFO: Scrape type for CD75324: 2
2026-03-28 18:32:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with identifier: CD75324
2026-03-28 18:32:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with scrape type 2
2026-03-28 18:32:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with scrape type 2
2026-03-28 18:32:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573, identifier: CD75324
2026-03-28 18:32:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with identifier: CD75324
2026-03-28 18:32:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with identifier: CD75324
2026-03-28 18:32:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573 with identifier: CD75324 to the API
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:34:41Z',
 'fuel_type': 'diesel',
 'id': 'dd0c0c9a-51ea-5c16-9b27-c9a7b69f5573',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD75324',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 188031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-31',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI JAKO-O Trendline',
 'transmission': 'manual',
 'trim': 'JAKO-O Trendline',
 'year': 2013}
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD75324%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Saving data for CD75324: {'auction_closing_time': 1774884881.0, 'created_time': 1774636235.26286, 'last_price_update_time': 1774722745.229719}
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD75324') HTTP/1.1" 204 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY62714%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for ZY62714: 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP95404%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for HP95404: 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN87800%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for CN87800: 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN68043%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for GN68043: 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR83846%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for CR83846: 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG64056%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for HG64056: 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH99848%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for UH99848: 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP05566%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for NP05566: 0
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-28 18:32:25 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83292%27 HTTP/1.1" 200 None
2026-03-28 18:32:25 [auto1.de] INFO: Scrape type for RL83292: 0
2026-03-28 18:32:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:26 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-28 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX99653%27 HTTP/1.1" 200 None
2026-03-28 18:32:26 [auto1.de] INFO: Scrape type for VX99653: 0
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-28 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP93113%27 HTTP/1.1" 200 None
2026-03-28 18:32:26 [auto1.de] INFO: Scrape type for MP93113: 0
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-28 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR08314%27 HTTP/1.1" 200 None
2026-03-28 18:32:26 [auto1.de] INFO: Scrape type for SR08314: 0
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-28 18:32:26 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-28 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-28 18:32:26 [auto1.de] INFO: Scrape type for BB98458: 2
2026-03-28 18:32:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9e8ef4a-c716-5274-9f4b-b70140f5928a with identifier: BB98458
2026-03-28 18:32:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9e8ef4a-c716-5274-9f4b-b70140f5928a with scrape type 2
2026-03-28 18:32:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9e8ef4a-c716-5274-9f4b-b70140f5928a with scrape type 2
2026-03-28 18:32:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9e8ef4a-c716-5274-9f4b-b70140f5928a, identifier: BB98458
2026-03-28 18:32:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9e8ef4a-c716-5274-9f4b-b70140f5928a with identifier: BB98458
2026-03-28 18:32:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9e8ef4a-c716-5274-9f4b-b70140f5928a with identifier: BB98458
2026-03-28 18:32:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9e8ef4a-c716-5274-9f4b-b70140f5928a with identifier: BB98458 to the API
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:56:57Z',
 'fuel_type': 'petrol',
 'id': 'c9e8ef4a-c716-5274-9f4b-b70140f5928a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB98458',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 22183,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-09',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line Vignale',
 'transmission': 'automatic',
 'trim': 'ST-Line Vignale',
 'year': 2021}
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB98458%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Saving data for BB98458: {'auction_closing_time': 1774886217.0, 'created_time': 1773466973.445288, 'last_price_update_time': 1774722747.341353}
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB98458') HTTP/1.1" 204 0
2026-03-28 18:32:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV84359%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for ZV84359: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88123%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for PY88123: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF95353%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for DF95353: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB88110%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for AB88110: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC26030%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for KC26030: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM35887%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for GM35887: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10791%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for HR10791: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM23375%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for PM23375: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW77657%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for BW77657: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE29906%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for ZE29906: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK83819%27 HTTP/1.1" 200 None
2026-03-28 18:32:27 [auto1.de] INFO: Scrape type for NK83819: 0
2026-03-28 18:32:27 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-28 18:32:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW88722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:28 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:28 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09458%27 HTTP/1.1" 200 None
2026-03-28 18:32:28 [auto1.de] INFO: Scrape type for LL09458: 0
2026-03-28 18:32:28 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ59930%27 HTTP/1.1" 200 None
2026-03-28 18:32:28 [auto1.de] INFO: Scrape type for ZZ59930: 0
2026-03-28 18:32:28 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-28 18:32:28 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX86336%27 HTTP/1.1" 200 None
2026-03-28 18:32:28 [auto1.de] INFO: Scrape type for LX86336: 0
2026-03-28 18:32:28 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67519%27 HTTP/1.1" 200 None
2026-03-28 18:32:28 [auto1.de] INFO: Scrape type for XY67519: 0
2026-03-28 18:32:28 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-28 18:32:28 [auto1.de] INFO: Scrape type for HH56316: 2
2026-03-28 18:32:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85b71412-e77f-5f61-bf1d-5350a5bafdaa with identifier: HH56316
2026-03-28 18:32:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85b71412-e77f-5f61-bf1d-5350a5bafdaa with scrape type 2
2026-03-28 18:32:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85b71412-e77f-5f61-bf1d-5350a5bafdaa with scrape type 2
2026-03-28 18:32:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85b71412-e77f-5f61-bf1d-5350a5bafdaa, identifier: HH56316
2026-03-28 18:32:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85b71412-e77f-5f61-bf1d-5350a5bafdaa with identifier: HH56316
2026-03-28 18:32:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85b71412-e77f-5f61-bf1d-5350a5bafdaa with identifier: HH56316
2026-03-28 18:32:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85b71412-e77f-5f61-bf1d-5350a5bafdaa with identifier: HH56316 to the API
2026-03-28 18:32:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:15Z',
 'fuel_type': 'diesel',
 'id': '85b71412-e77f-5f61-bf1d-5350a5bafdaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH56316',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 217113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH56316%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Saving data for HH56316: {'auction_closing_time': 1774884735.0, 'created_time': 1774522283.021663, 'last_price_update_time': 1774722749.205957}
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH56316') HTTP/1.1" 204 0
2026-03-28 18:32:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU82814%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Scrape type for AU82814: 0
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT42792%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Scrape type for VT42792: 0
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX25662%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Scrape type for FX25662: 0
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80548%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Scrape type for RX80548: 0
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF83287%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Scrape type for XF83287: 0
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX91762%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Scrape type for WX91762: 0
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Scrape type for YT57989: 2
2026-03-28 18:32:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9c0a936-6110-5211-82a2-53b21169dc3e with identifier: YT57989
2026-03-28 18:32:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9c0a936-6110-5211-82a2-53b21169dc3e with scrape type 2
2026-03-28 18:32:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9c0a936-6110-5211-82a2-53b21169dc3e with scrape type 2
2026-03-28 18:32:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9c0a936-6110-5211-82a2-53b21169dc3e, identifier: YT57989
2026-03-28 18:32:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9c0a936-6110-5211-82a2-53b21169dc3e with identifier: YT57989
2026-03-28 18:32:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9c0a936-6110-5211-82a2-53b21169dc3e with identifier: YT57989
2026-03-28 18:32:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9c0a936-6110-5211-82a2-53b21169dc3e with identifier: YT57989 to the API
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:05:18Z',
 'fuel_type': 'diesel',
 'id': 'f9c0a936-6110-5211-82a2-53b21169dc3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT57989',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 244573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-17',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive',
 'transmission': 'manual',
 'trim': 'xDrive',
 'year': 2011}
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT57989%27 HTTP/1.1" 200 None
2026-03-28 18:32:29 [auto1.de] INFO: Saving data for YT57989: {'auction_closing_time': 1774883118.0, 'created_time': 1774521896.857507, 'last_price_update_time': 1774722749.880888}
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT57989') HTTP/1.1" 204 0
2026-03-28 18:32:29 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS13151%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for JS13151: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF38330%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for NF38330: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN67073%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for WN67073: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47676%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for ZS47676: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for CM15300: 2
2026-03-28 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36abdd27-a159-58c7-ad06-27686163d3f1 with identifier: CM15300
2026-03-28 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36abdd27-a159-58c7-ad06-27686163d3f1 with scrape type 2
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36abdd27-a159-58c7-ad06-27686163d3f1 with scrape type 2
2026-03-28 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36abdd27-a159-58c7-ad06-27686163d3f1, identifier: CM15300
2026-03-28 18:32:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW88722> (referer: https://www.auto1.com/v1/car-details-view/AW88722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36abdd27-a159-58c7-ad06-27686163d3f1 with identifier: CM15300
2026-03-28 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36abdd27-a159-58c7-ad06-27686163d3f1 with identifier: CM15300
2026-03-28 18:32:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36abdd27-a159-58c7-ad06-27686163d3f1 with identifier: CM15300 to the API
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:15Z',
 'fuel_type': 'petrol',
 'id': '36abdd27-a159-58c7-ad06-27686163d3f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM15300',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 30243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-24',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2020}
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM15300%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Saving data for CM15300: {'auction_closing_time': 1774883115.0, 'created_time': 1773387056.450722, 'last_price_update_time': 1774722750.484456}
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM15300') HTTP/1.1" 204 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN76417%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for BN76417: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC93517%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for EC93517: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN35790%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for YN35790: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW08292%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for AW08292: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT29180%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for LT29180: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND34621%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for ND34621: 0
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-28 18:32:30 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT97147%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [auto1.de] INFO: Scrape type for BT97147: 0
2026-03-28 18:32:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-03-28 18:32:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db856033-7507-5080-8c54-52e42804df02 with scrape type 1
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db856033-7507-5080-8c54-52e42804df02
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_37c780a210aaad4041d50fb2006b55ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_37c780a210aaad4041d50fb2006b55ab.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_206e99255e0a48a4c44fa0935cf2795d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_206e99255e0a48a4c44fa0935cf2795d.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_47afb5c5210c8a54e6da8732dc762c03.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_47afb5c5210c8a54e6da8732dc762c03.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_66a53cc02f932eaa6394f5fdf4e84e0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66a53cc02f932eaa6394f5fdf4e84e0f.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_32550d3dfc2b59dcea96798d7706765d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_32550d3dfc2b59dcea96798d7706765d.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_aa52d074301982e953256cc0e7d4ff66.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_aa52d074301982e953256cc0e7d4ff66.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_d6bdcd2fc8d2f5dcfadbee01f5686071.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_d6bdcd2fc8d2f5dcfadbee01f5686071.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_0cc63854e75f07f540aec572abdf0bc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_0cc63854e75f07f540aec572abdf0bc0.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_66f48d2432bb519ff9baa69eb3867e49.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66f48d2432bb519ff9baa69eb3867e49.jpg already downloaded
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252Fa8%252Fc4a8c90f9d4df2b516701a0421e49a09%252Fpa%252FAW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:32:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg already downloaded
2026-03-28 18:32:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db856033-7507-5080-8c54-52e42804df02, identifier: AW88722
2026-03-28 18:32:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-03-28 18:32:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722
2026-03-28 18:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db856033-7507-5080-8c54-52e42804df02 with identifier: AW88722 to the API
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AW88722>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:39:41Z',
 'fuel_type': 'petrol',
 'id': 'db856033-7507-5080-8c54-52e42804df02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW88722',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 36331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_37c780a210aaad4041d50fb2006b55ab.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_206e99255e0a48a4c44fa0935cf2795d.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_47afb5c5210c8a54e6da8732dc762c03.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66a53cc02f932eaa6394f5fdf4e84e0f.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_32550d3dfc2b59dcea96798d7706765d.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_aa52d074301982e953256cc0e7d4ff66.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_d6bdcd2fc8d2f5dcfadbee01f5686071.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_0cc63854e75f07f540aec572abdf0bc0.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66f48d2432bb519ff9baa69eb3867e49.jpg',
                'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_37c780a210aaad4041d50fb2006b55ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_206e99255e0a48a4c44fa0935cf2795d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2379048,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_47afb5c5210c8a54e6da8732dc762c03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2071467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66a53cc02f932eaa6394f5fdf4e84e0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_32550d3dfc2b59dcea96798d7706765d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_aa52d074301982e953256cc0e7d4ff66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_d6bdcd2fc8d2f5dcfadbee01f5686071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_0cc63854e75f07f540aec572abdf0bc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_66f48d2432bb519ff9baa69eb3867e49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db856033-7507-5080-8c54-52e42804df02/db856033-7507-5080-8c54-52e42804df02_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2379283,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/a8/c4a8c90f9d4df2b516701a0421e49a09/pa/AW88722_c52d5e8b8ee747f67149c0231bb5703b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW88722%27 HTTP/1.1" 200 None
2026-03-28 18:32:31 [auto1.de] INFO: Saving data for AW88722: {'created_time': 1774722751.466357, 'last_price_update_time': 1774722751.466368, 'auction_closing_time': 1774885181.0}
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW88722') HTTP/1.1" 204 0
2026-03-28 18:32:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:31 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 5993 | hits on page: 40
2026-03-28 18:32:31 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-28 18:32:31 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-28 18:32:31 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC63070%27 HTTP/1.1" 200 None
2026-03-28 18:32:31 [auto1.de] INFO: Scrape type for VC63070: 0
2026-03-28 18:32:31 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95124%27 HTTP/1.1" 200 None
2026-03-28 18:32:31 [auto1.de] INFO: Scrape type for EY95124: 0
2026-03-28 18:32:31 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS47170%27 HTTP/1.1" 200 None
2026-03-28 18:32:31 [auto1.de] INFO: Scrape type for PS47170: 0
2026-03-28 18:32:31 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-28 18:32:31 [auto1.de] INFO: Scrape type for TF71705: 2
2026-03-28 18:32:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b595b112-23bc-5c26-a2e7-7992cc165dda with identifier: TF71705
2026-03-28 18:32:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b595b112-23bc-5c26-a2e7-7992cc165dda with scrape type 2
2026-03-28 18:32:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b595b112-23bc-5c26-a2e7-7992cc165dda with scrape type 2
2026-03-28 18:32:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b595b112-23bc-5c26-a2e7-7992cc165dda, identifier: TF71705
2026-03-28 18:32:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b595b112-23bc-5c26-a2e7-7992cc165dda with identifier: TF71705
2026-03-28 18:32:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b595b112-23bc-5c26-a2e7-7992cc165dda with identifier: TF71705
2026-03-28 18:32:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b595b112-23bc-5c26-a2e7-7992cc165dda with identifier: TF71705 to the API
2026-03-28 18:32:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:48:55Z',
 'fuel_type': 'petrol',
 'id': 'b595b112-23bc-5c26-a2e7-7992cc165dda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF71705',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 100530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-20',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF71705%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Saving data for TF71705: {'auction_closing_time': 1774885735.0, 'created_time': 1774636313.028779, 'last_price_update_time': 1774722752.15816}
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF71705') HTTP/1.1" 204 0
2026-03-28 18:32:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT86563%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for WT86563: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP30062%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for DP30062: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM03411%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for RM03411: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47814%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for YJ47814: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for AG08443: 2
2026-03-28 18:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff62bfea-5c5f-5c3f-919d-29caaa75af5c with identifier: AG08443
2026-03-28 18:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff62bfea-5c5f-5c3f-919d-29caaa75af5c with scrape type 2
2026-03-28 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff62bfea-5c5f-5c3f-919d-29caaa75af5c with scrape type 2
2026-03-28 18:32:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff62bfea-5c5f-5c3f-919d-29caaa75af5c, identifier: AG08443
2026-03-28 18:32:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff62bfea-5c5f-5c3f-919d-29caaa75af5c with identifier: AG08443
2026-03-28 18:32:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff62bfea-5c5f-5c3f-919d-29caaa75af5c with identifier: AG08443
2026-03-28 18:32:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff62bfea-5c5f-5c3f-919d-29caaa75af5c with identifier: AG08443 to the API
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:24:19Z',
 'fuel_type': 'petrol',
 'id': 'ff62bfea-5c5f-5c3f-919d-29caaa75af5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG08443',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 5323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-01',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2024}
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG08443%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Saving data for AG08443: {'auction_closing_time': 1774884259.0, 'created_time': 1774522287.468967, 'last_price_update_time': 1774722752.71609}
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG08443') HTTP/1.1" 204 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD56842%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for TD56842: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ16531%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for AJ16531: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ76786%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for XZ76786: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR99013%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for KR99013: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX12116%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for KX12116: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12906%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for RK12906: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB93359%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for VB93359: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG02124%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for XG02124: 0
2026-03-28 18:32:32 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-28 18:32:32 [auto1.de] INFO: Scrape type for AL45510: 2
2026-03-28 18:32:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4523eb2-f67f-53b2-a556-693798ed8a5c with identifier: AL45510
2026-03-28 18:32:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4523eb2-f67f-53b2-a556-693798ed8a5c with scrape type 2
2026-03-28 18:32:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4523eb2-f67f-53b2-a556-693798ed8a5c with scrape type 2
2026-03-28 18:32:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4523eb2-f67f-53b2-a556-693798ed8a5c, identifier: AL45510
2026-03-28 18:32:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4523eb2-f67f-53b2-a556-693798ed8a5c with identifier: AL45510
2026-03-28 18:32:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4523eb2-f67f-53b2-a556-693798ed8a5c with identifier: AL45510
2026-03-28 18:32:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4523eb2-f67f-53b2-a556-693798ed8a5c with identifier: AL45510 to the API
2026-03-28 18:32:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:47:12Z',
 'fuel_type': 'petrol',
 'id': 'e4523eb2-f67f-53b2-a556-693798ed8a5c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL45510',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 154940,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL45510%27 HTTP/1.1" 200 None
2026-03-28 18:32:33 [auto1.de] INFO: Saving data for AL45510: {'auction_closing_time': 1774885632.0, 'created_time': 1774031534.622478, 'last_price_update_time': 1774722753.942383}
2026-03-28 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL45510') HTTP/1.1" 204 0
2026-03-28 18:32:34 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-28 18:32:34 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-28 18:32:34 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-28 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-28 18:32:34 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-28 18:32:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:35 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 5994 | hits on page: 40
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ61824%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for GJ61824: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC90555%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for DC90555: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK65785%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for AK65785: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW17852%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for AW17852: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG34201%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for EG34201: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ79893%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for ZZ79893: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY57435%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for AY57435: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for YH76604: 2
2026-03-28 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with identifier: YH76604
2026-03-28 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with scrape type 2
2026-03-28 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with scrape type 2
2026-03-28 18:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4d65542-27cb-5bc6-9c90-e6c74d3ff839, identifier: YH76604
2026-03-28 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with identifier: YH76604
2026-03-28 18:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with identifier: YH76604
2026-03-28 18:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4d65542-27cb-5bc6-9c90-e6c74d3ff839 with identifier: YH76604 to the API
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:54Z',
 'fuel_type': 'petrol',
 'id': 'a4d65542-27cb-5bc6-9c90-e6c74d3ff839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH76604',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 17609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-05',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2022}
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH76604%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Saving data for YH76604: {'auction_closing_time': 1774885494.0, 'created_time': 1774521646.812735, 'last_price_update_time': 1774722755.554934}
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH76604') HTTP/1.1" 204 0
2026-03-28 18:32:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX98591%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for VX98591: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD44201%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for BD44201: 0
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-28 18:32:35 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-28 18:32:35 [auto1.de] INFO: Scrape type for NG07529: 2
2026-03-28 18:32:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 669d0112-9e4f-53f1-bc26-c617ed536000 with identifier: NG07529
2026-03-28 18:32:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 669d0112-9e4f-53f1-bc26-c617ed536000 with scrape type 2
2026-03-28 18:32:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 669d0112-9e4f-53f1-bc26-c617ed536000 with scrape type 2
2026-03-28 18:32:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 669d0112-9e4f-53f1-bc26-c617ed536000, identifier: NG07529
2026-03-28 18:32:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 669d0112-9e4f-53f1-bc26-c617ed536000 with identifier: NG07529
2026-03-28 18:32:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 669d0112-9e4f-53f1-bc26-c617ed536000 with identifier: NG07529
2026-03-28 18:32:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 669d0112-9e4f-53f1-bc26-c617ed536000 with identifier: NG07529 to the API
2026-03-28 18:32:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:26Z',
 'fuel_type': 'diesel',
 'id': '669d0112-9e4f-53f1-bc26-c617ed536000',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG07529',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 159522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-01',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG07529%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Saving data for NG07529: {'auction_closing_time': 1774884686.0, 'created_time': 1773343465.60809, 'last_price_update_time': 1774722756.178397}
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG07529') HTTP/1.1" 204 0
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97857%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Scrape type for YY97857: 0
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR76257%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Scrape type for LR76257: 0
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Scrape type for DS47068: 2
2026-03-28 18:32:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42faee34-d0da-5db2-9cd5-5cbb3913290d with identifier: DS47068
2026-03-28 18:32:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42faee34-d0da-5db2-9cd5-5cbb3913290d with scrape type 2
2026-03-28 18:32:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42faee34-d0da-5db2-9cd5-5cbb3913290d with scrape type 2
2026-03-28 18:32:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42faee34-d0da-5db2-9cd5-5cbb3913290d, identifier: DS47068
2026-03-28 18:32:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42faee34-d0da-5db2-9cd5-5cbb3913290d with identifier: DS47068
2026-03-28 18:32:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42faee34-d0da-5db2-9cd5-5cbb3913290d with identifier: DS47068
2026-03-28 18:32:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42faee34-d0da-5db2-9cd5-5cbb3913290d with identifier: DS47068 to the API
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:49:55Z',
 'fuel_type': 'diesel',
 'id': '42faee34-d0da-5db2-9cd5-5cbb3913290d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS47068',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 197112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-17',
 'seller_name': None,
 'title': 'BMW 5er 525d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS47068%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Saving data for DS47068: {'auction_closing_time': 1774885795.0, 'created_time': 1773399504.68243, 'last_price_update_time': 1774722756.746733}
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS47068') HTTP/1.1" 204 0
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC50657%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Scrape type for DC50657: 0
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77842%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Scrape type for LC77842: 0
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX10113%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Scrape type for UX10113: 0
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-28 18:32:36 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE35535%27 HTTP/1.1" 200 None
2026-03-28 18:32:36 [auto1.de] INFO: Scrape type for TE35535: 0
2026-03-28 18:32:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:38 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 5994 | hits on page: 40
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF78558%27 HTTP/1.1" 200 None
2026-03-28 18:32:38 [auto1.de] INFO: Scrape type for YF78558: 0
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS73974%27 HTTP/1.1" 200 None
2026-03-28 18:32:38 [auto1.de] INFO: Scrape type for MS73974: 0
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE26333%27 HTTP/1.1" 200 None
2026-03-28 18:32:38 [auto1.de] INFO: Scrape type for XE26333: 0
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL91395%27 HTTP/1.1" 200 None
2026-03-28 18:32:38 [auto1.de] INFO: Scrape type for EL91395: 0
2026-03-28 18:32:38 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-28 18:32:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-28 18:32:39 [auto1.de] INFO: Scrape type for RK13717: 2
2026-03-28 18:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8821174b-8858-519f-b316-aa8a59f896ba with identifier: RK13717
2026-03-28 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8821174b-8858-519f-b316-aa8a59f896ba with scrape type 2
2026-03-28 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8821174b-8858-519f-b316-aa8a59f896ba with scrape type 2
2026-03-28 18:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8821174b-8858-519f-b316-aa8a59f896ba, identifier: RK13717
2026-03-28 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8821174b-8858-519f-b316-aa8a59f896ba with identifier: RK13717
2026-03-28 18:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8821174b-8858-519f-b316-aa8a59f896ba with identifier: RK13717
2026-03-28 18:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8821174b-8858-519f-b316-aa8a59f896ba with identifier: RK13717 to the API
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:39:49Z',
 'fuel_type': 'petrol',
 'id': '8821174b-8858-519f-b316-aa8a59f896ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK13717',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 75633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Vignale',
 'transmission': 'manual',
 'trim': 'Vignale',
 'year': 2020}
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK13717%27 HTTP/1.1" 200 None
2026-03-28 18:32:39 [auto1.de] INFO: Saving data for RK13717: {'auction_closing_time': 1774885189.0, 'created_time': 1774522316.792286, 'last_price_update_time': 1774722759.411911}
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK13717') HTTP/1.1" 204 0
2026-03-28 18:32:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:39 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX68666%27 HTTP/1.1" 200 None
2026-03-28 18:32:39 [auto1.de] INFO: Scrape type for NX68666: 0
2026-03-28 18:32:39 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-28 18:32:39 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN65444%27 HTTP/1.1" 200 None
2026-03-28 18:32:39 [auto1.de] INFO: Scrape type for KN65444: 0
2026-03-28 18:32:39 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB01944%27 HTTP/1.1" 200 None
2026-03-28 18:32:39 [auto1.de] INFO: Scrape type for EB01944: 0
2026-03-28 18:32:39 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-28 18:32:39 [auto1.de] INFO: Scrape type for TU73668: 2
2026-03-28 18:32:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with identifier: TU73668
2026-03-28 18:32:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with scrape type 2
2026-03-28 18:32:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with scrape type 2
2026-03-28 18:32:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4, identifier: TU73668
2026-03-28 18:32:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with identifier: TU73668
2026-03-28 18:32:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with identifier: TU73668
2026-03-28 18:32:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4 with identifier: TU73668 to the API
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:34:24Z',
 'fuel_type': 'petrol',
 'id': 'ea86fd4c-b410-53ac-ab0e-5d1f29fbd4f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU73668',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5 Sportback',
 'odometer': 169049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 18:32:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU73668%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Saving data for TU73668: {'auction_closing_time': 1774884864.0, 'created_time': 1773224092.670537, 'last_price_update_time': 1774722760.001516}
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TU73668') HTTP/1.1" 204 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR96368%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for TR96368: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX08499%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for SX08499: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ99986%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for NJ99986: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM66171%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for KM66171: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT08625%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for PT08625: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM95018%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for HM95018: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR56038%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for JR56038: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39643%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for ZR39643: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34004%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for PJ34004: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37752%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for MX37752: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL65692%27 HTTP/1.1" 200 None
2026-03-28 18:32:40 [auto1.de] INFO: Scrape type for JL65692: 0
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-28 18:32:40 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-28 18:32:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:41 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 5994 | hits on page: 40
2026-03-28 18:32:41 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-28 18:32:41 [auto1.de] INFO: Scrape type for LK79875: 2
2026-03-28 18:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b86f708b-ed24-5274-b1b7-861ba7a6be0d with identifier: LK79875
2026-03-28 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b86f708b-ed24-5274-b1b7-861ba7a6be0d with scrape type 2
2026-03-28 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b86f708b-ed24-5274-b1b7-861ba7a6be0d with scrape type 2
2026-03-28 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b86f708b-ed24-5274-b1b7-861ba7a6be0d, identifier: LK79875
2026-03-28 18:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b86f708b-ed24-5274-b1b7-861ba7a6be0d with identifier: LK79875
2026-03-28 18:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b86f708b-ed24-5274-b1b7-861ba7a6be0d with identifier: LK79875
2026-03-28 18:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b86f708b-ed24-5274-b1b7-861ba7a6be0d with identifier: LK79875 to the API
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:50:26Z',
 'fuel_type': 'petrol',
 'id': 'b86f708b-ed24-5274-b1b7-861ba7a6be0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK79875',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 48222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-12',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2017}
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK79875%27 HTTP/1.1" 200 None
2026-03-28 18:32:41 [auto1.de] INFO: Saving data for LK79875: {'auction_closing_time': 1774885826.0, 'created_time': 1774521909.589608, 'last_price_update_time': 1774722761.58224}
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK79875') HTTP/1.1" 204 0
2026-03-28 18:32:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:41 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-28 18:32:41 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-28 18:32:41 [auto1.de] INFO: Scrape type for AG47249: 2
2026-03-28 18:32:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3a6adb2-a393-50b7-8a9a-7045b947086d with identifier: AG47249
2026-03-28 18:32:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3a6adb2-a393-50b7-8a9a-7045b947086d with scrape type 2
2026-03-28 18:32:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3a6adb2-a393-50b7-8a9a-7045b947086d with scrape type 2
2026-03-28 18:32:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3a6adb2-a393-50b7-8a9a-7045b947086d, identifier: AG47249
2026-03-28 18:32:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3a6adb2-a393-50b7-8a9a-7045b947086d with identifier: AG47249
2026-03-28 18:32:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3a6adb2-a393-50b7-8a9a-7045b947086d with identifier: AG47249
2026-03-28 18:32:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3a6adb2-a393-50b7-8a9a-7045b947086d with identifier: AG47249 to the API
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:43:37Z',
 'fuel_type': 'diesel',
 'id': 'f3a6adb2-a393-50b7-8a9a-7045b947086d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG47249',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 250528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-11',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2013}
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG47249%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Saving data for AG47249: {'auction_closing_time': 1774885417.0, 'created_time': 1773945113.523103, 'last_price_update_time': 1774722762.094817}
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AG47249') HTTP/1.1" 204 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK34875%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for LK34875: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB46013%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for DB46013: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY55649%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for EY55649: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51376%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for ER51376: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB43693%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for XB43693: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU79634%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for EU79634: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS53864%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for HS53864: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for RR35143: 2
2026-03-28 18:32:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19654a9a-8fae-5999-901c-6b6b923a2a58 with identifier: RR35143
2026-03-28 18:32:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19654a9a-8fae-5999-901c-6b6b923a2a58 with scrape type 2
2026-03-28 18:32:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19654a9a-8fae-5999-901c-6b6b923a2a58 with scrape type 2
2026-03-28 18:32:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19654a9a-8fae-5999-901c-6b6b923a2a58, identifier: RR35143
2026-03-28 18:32:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19654a9a-8fae-5999-901c-6b6b923a2a58 with identifier: RR35143
2026-03-28 18:32:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19654a9a-8fae-5999-901c-6b6b923a2a58 with identifier: RR35143
2026-03-28 18:32:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19654a9a-8fae-5999-901c-6b6b923a2a58 with identifier: RR35143 to the API
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:01:44Z',
 'fuel_type': 'petrol',
 'id': '19654a9a-8fae-5999-901c-6b6b923a2a58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR35143',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 152909,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-03',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2008}
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR35143%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Saving data for RR35143: {'auction_closing_time': 1774882904.0, 'created_time': 1774521531.714036, 'last_price_update_time': 1774722762.721483}
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR35143') HTTP/1.1" 204 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW28946%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for XW28946: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96980%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for KJ96980: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20956%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for SK20956: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA39123%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for SA39123: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE03555%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for GE03555: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB40080%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for AB40080: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM98964%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for LM98964: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ98180%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for BJ98180: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY37454%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for PY37454: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ53370%27 HTTP/1.1" 200 None
2026-03-28 18:32:42 [auto1.de] INFO: Scrape type for RZ53370: 0
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-28 18:32:42 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-28 18:32:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:44 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 5994 | hits on page: 40
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN22226%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for PN22226: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ47160%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for YJ47160: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU43225%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for GU43225: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73293%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for MR73293: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG40068%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for UG40068: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG26326%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for VG26326: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78869%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for WG78869: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS31219%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for JS31219: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for NR99017: 2
2026-03-28 18:32:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf9b14c-e924-55a3-b819-cde7586181d1 with identifier: NR99017
2026-03-28 18:32:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf9b14c-e924-55a3-b819-cde7586181d1 with scrape type 2
2026-03-28 18:32:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cf9b14c-e924-55a3-b819-cde7586181d1 with scrape type 2
2026-03-28 18:32:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2cf9b14c-e924-55a3-b819-cde7586181d1, identifier: NR99017
2026-03-28 18:32:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2cf9b14c-e924-55a3-b819-cde7586181d1 with identifier: NR99017
2026-03-28 18:32:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2cf9b14c-e924-55a3-b819-cde7586181d1 with identifier: NR99017
2026-03-28 18:32:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2cf9b14c-e924-55a3-b819-cde7586181d1 with identifier: NR99017 to the API
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:48:45Z',
 'fuel_type': 'diesel',
 'id': '2cf9b14c-e924-55a3-b819-cde7586181d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR99017',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 326974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-09',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 300 L1 Tourneo Trend',
 'transmission': 'manual',
 'trim': '300 L1 Tourneo Trend',
 'year': 2014}
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR99017%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Saving data for NR99017: {'auction_closing_time': 1774885725.0, 'created_time': 1774118883.149503, 'last_price_update_time': 1774722764.871937}
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR99017') HTTP/1.1" 204 0
2026-03-28 18:32:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM19192%27 HTTP/1.1" 200 None
2026-03-28 18:32:44 [auto1.de] INFO: Scrape type for WM19192: 0
2026-03-28 18:32:44 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF26076%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for TF26076: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB50510%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for HB50510: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC97155%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for BC97155: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG31593%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for VG31593: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE19276%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for EE19276: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for VT68593: 2
2026-03-28 18:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de50f8cf-9396-5416-9012-dad0e7217281 with identifier: VT68593
2026-03-28 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de50f8cf-9396-5416-9012-dad0e7217281 with scrape type 2
2026-03-28 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de50f8cf-9396-5416-9012-dad0e7217281 with scrape type 2
2026-03-28 18:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de50f8cf-9396-5416-9012-dad0e7217281, identifier: VT68593
2026-03-28 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de50f8cf-9396-5416-9012-dad0e7217281 with identifier: VT68593
2026-03-28 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de50f8cf-9396-5416-9012-dad0e7217281 with identifier: VT68593
2026-03-28 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de50f8cf-9396-5416-9012-dad0e7217281 with identifier: VT68593 to the API
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:47:41Z',
 'fuel_type': 'diesel',
 'id': 'de50f8cf-9396-5416-9012-dad0e7217281',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT68593',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 190377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-11',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT68593%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Saving data for VT68593: {'auction_closing_time': 1774885661.0, 'created_time': 1774032420.878973, 'last_price_update_time': 1774722765.511266}
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT68593') HTTP/1.1" 204 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM92745%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for UM92745: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08912%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for YA08912: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT19745%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for ZT19745: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF43262%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for JF43262: 0
2026-03-28 18:32:45 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-28 18:32:45 [auto1.de] INFO: Scrape type for KN67174: 2
2026-03-28 18:32:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with identifier: KN67174
2026-03-28 18:32:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with scrape type 2
2026-03-28 18:32:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with scrape type 2
2026-03-28 18:32:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac, identifier: KN67174
2026-03-28 18:32:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with identifier: KN67174
2026-03-28 18:32:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with identifier: KN67174
2026-03-28 18:32:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac with identifier: KN67174 to the API
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:55:45Z',
 'fuel_type': 'petrol',
 'id': '488c6c4b-fa5b-54d6-a10e-ea75c2c6e6ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN67174',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 30709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN67174%27 HTTP/1.1" 200 None
2026-03-28 18:32:46 [auto1.de] INFO: Saving data for KN67174: {'auction_closing_time': 1774886145.0, 'created_time': 1774636288.00343, 'last_price_update_time': 1774722766.068222}
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN67174') HTTP/1.1" 204 0
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX72807%27 HTTP/1.1" 200 None
2026-03-28 18:32:46 [auto1.de] INFO: Scrape type for EX72807: 0
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL65156%27 HTTP/1.1" 200 None
2026-03-28 18:32:46 [auto1.de] INFO: Scrape type for TL65156: 0
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-28 18:32:46 [auto1.de] INFO: Scrape type for WP12836: 2
2026-03-28 18:32:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with identifier: WP12836
2026-03-28 18:32:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with scrape type 2
2026-03-28 18:32:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with scrape type 2
2026-03-28 18:32:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d, identifier: WP12836
2026-03-28 18:32:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with identifier: WP12836
2026-03-28 18:32:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with identifier: WP12836
2026-03-28 18:32:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0be48c5-5924-5b86-8fd7-3a8ee27ed12d with identifier: WP12836 to the API
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:18:39Z',
 'fuel_type': 'diesel',
 'id': 'e0be48c5-5924-5b86-8fd7-3a8ee27ed12d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP12836',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 94396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-16',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP12836%27 HTTP/1.1" 200 None
2026-03-28 18:32:46 [auto1.de] INFO: Saving data for WP12836: {'auction_closing_time': 1774883919.0, 'created_time': 1774636319.587869, 'last_price_update_time': 1774722766.639057}
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP12836') HTTP/1.1" 204 0
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE62435%27 HTTP/1.1" 200 None
2026-03-28 18:32:46 [auto1.de] INFO: Scrape type for NE62435: 0
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK84470%27 HTTP/1.1" 200 None
2026-03-28 18:32:46 [auto1.de] INFO: Scrape type for CK84470: 0
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-28 18:32:46 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB59587%27 HTTP/1.1" 200 None
2026-03-28 18:32:46 [auto1.de] INFO: Scrape type for GB59587: 0
2026-03-28 18:32:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:47 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 5994 | hits on page: 40
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA60360%27 HTTP/1.1" 200 None
2026-03-28 18:32:47 [auto1.de] INFO: Scrape type for UA60360: 0
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM56481%27 HTTP/1.1" 200 None
2026-03-28 18:32:47 [auto1.de] INFO: Scrape type for FM56481: 0
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: US78573
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW80627%27 HTTP/1.1" 200 None
2026-03-28 18:32:47 [auto1.de] INFO: Scrape type for PW80627: 0
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65179%27 HTTP/1.1" 200 None
2026-03-28 18:32:47 [auto1.de] INFO: Scrape type for AH65179: 0
2026-03-28 18:32:47 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-28 18:32:47 [auto1.de] INFO: Scrape type for JB50627: 2
2026-03-28 18:32:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3a60d5d-d546-5d35-af3e-39a75b65a2fd with identifier: JB50627
2026-03-28 18:32:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3a60d5d-d546-5d35-af3e-39a75b65a2fd with scrape type 2
2026-03-28 18:32:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3a60d5d-d546-5d35-af3e-39a75b65a2fd with scrape type 2
2026-03-28 18:32:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3a60d5d-d546-5d35-af3e-39a75b65a2fd, identifier: JB50627
2026-03-28 18:32:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3a60d5d-d546-5d35-af3e-39a75b65a2fd with identifier: JB50627
2026-03-28 18:32:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3a60d5d-d546-5d35-af3e-39a75b65a2fd with identifier: JB50627
2026-03-28 18:32:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3a60d5d-d546-5d35-af3e-39a75b65a2fd with identifier: JB50627 to the API
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:21:20Z',
 'fuel_type': 'diesel',
 'id': 'a3a60d5d-d546-5d35-af3e-39a75b65a2fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB50627',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 202081,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Audi A1 2.0 TDI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2012}
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB50627%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Saving data for JB50627: {'auction_closing_time': 1774884080.0, 'created_time': 1773467432.011045, 'last_price_update_time': 1774722768.096547}
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB50627') HTTP/1.1" 204 0
2026-03-28 18:32:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR10562%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for HR10562: 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST57334%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for ST57334: 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF39323%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for SF39323: 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF29194%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for UF29194: 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN12872%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for RN12872: 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for NP24686: 2
2026-03-28 18:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90905aee-f780-51a9-a87d-3ea2591eaa0a with identifier: NP24686
2026-03-28 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90905aee-f780-51a9-a87d-3ea2591eaa0a with scrape type 2
2026-03-28 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90905aee-f780-51a9-a87d-3ea2591eaa0a with scrape type 2
2026-03-28 18:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90905aee-f780-51a9-a87d-3ea2591eaa0a, identifier: NP24686
2026-03-28 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90905aee-f780-51a9-a87d-3ea2591eaa0a with identifier: NP24686
2026-03-28 18:32:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90905aee-f780-51a9-a87d-3ea2591eaa0a with identifier: NP24686
2026-03-28 18:32:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90905aee-f780-51a9-a87d-3ea2591eaa0a with identifier: NP24686 to the API
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:02:04Z',
 'fuel_type': 'diesel',
 'id': '90905aee-f780-51a9-a87d-3ea2591eaa0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP24686',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 250385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-23',
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP24686%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Saving data for NP24686: {'auction_closing_time': 1774882924.0, 'created_time': 1773226159.690466, 'last_price_update_time': 1774722768.732123}
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP24686') HTTP/1.1" 204 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR67134%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for NR67134: 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM90118%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for WM90118: 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD77905%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for WD77905: 0
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-28 18:32:48 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-28 18:32:48 [auto1.de] INFO: Scrape type for AA40394: 2
2026-03-28 18:32:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 296f25d4-8556-5d3b-9ea0-338e1f961791 with identifier: AA40394
2026-03-28 18:32:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296f25d4-8556-5d3b-9ea0-338e1f961791 with scrape type 2
2026-03-28 18:32:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 296f25d4-8556-5d3b-9ea0-338e1f961791 with scrape type 2
2026-03-28 18:32:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 296f25d4-8556-5d3b-9ea0-338e1f961791, identifier: AA40394
2026-03-28 18:32:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 296f25d4-8556-5d3b-9ea0-338e1f961791 with identifier: AA40394
2026-03-28 18:32:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 296f25d4-8556-5d3b-9ea0-338e1f961791 with identifier: AA40394
2026-03-28 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 296f25d4-8556-5d3b-9ea0-338e1f961791 with identifier: AA40394 to the API
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:21Z',
 'fuel_type': 'diesel',
 'id': '296f25d4-8556-5d3b-9ea0-338e1f961791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA40394',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 116846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-06',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2018}
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA40394%27 HTTP/1.1" 200 None
2026-03-28 18:32:49 [auto1.de] INFO: Saving data for AA40394: {'auction_closing_time': 1774885761.0, 'created_time': 1773426662.397338, 'last_price_update_time': 1774722769.443392}
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA40394') HTTP/1.1" 204 0
2026-03-28 18:32:49 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD45301%27 HTTP/1.1" 200 None
2026-03-28 18:32:49 [auto1.de] INFO: Scrape type for CD45301: 0
2026-03-28 18:32:49 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-28 18:32:49 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-28 18:32:49 [auto1.de] INFO: Scrape type for AM35234: 2
2026-03-28 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cc9e197-b56d-5192-be19-93ba901c6034 with identifier: AM35234
2026-03-28 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cc9e197-b56d-5192-be19-93ba901c6034 with scrape type 2
2026-03-28 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cc9e197-b56d-5192-be19-93ba901c6034 with scrape type 2
2026-03-28 18:32:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cc9e197-b56d-5192-be19-93ba901c6034, identifier: AM35234
2026-03-28 18:32:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cc9e197-b56d-5192-be19-93ba901c6034 with identifier: AM35234
2026-03-28 18:32:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cc9e197-b56d-5192-be19-93ba901c6034 with identifier: AM35234
2026-03-28 18:32:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cc9e197-b56d-5192-be19-93ba901c6034 with identifier: AM35234 to the API
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:31:43Z',
 'fuel_type': 'diesel',
 'id': '4cc9e197-b56d-5192-be19-93ba901c6034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM35234',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 233399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-06',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM35234%27 HTTP/1.1" 200 None
2026-03-28 18:32:49 [auto1.de] INFO: Saving data for AM35234: {'auction_closing_time': 1774884703.0, 'created_time': 1774522635.52179, 'last_price_update_time': 1774722769.895703}
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM35234') HTTP/1.1" 204 0
2026-03-28 18:32:49 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-28 18:32:49 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK58457%27 HTTP/1.1" 200 None
2026-03-28 18:32:49 [auto1.de] INFO: Scrape type for CK58457: 0
2026-03-28 18:32:49 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-28 18:32:49 [auto1.de] INFO: Scrape type for XN62659: 2
2026-03-28 18:32:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643c420a-25fc-5e55-bca9-719cd38a97ef with identifier: XN62659
2026-03-28 18:32:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643c420a-25fc-5e55-bca9-719cd38a97ef with scrape type 2
2026-03-28 18:32:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643c420a-25fc-5e55-bca9-719cd38a97ef with scrape type 2
2026-03-28 18:32:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643c420a-25fc-5e55-bca9-719cd38a97ef, identifier: XN62659
2026-03-28 18:32:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643c420a-25fc-5e55-bca9-719cd38a97ef with identifier: XN62659
2026-03-28 18:32:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643c420a-25fc-5e55-bca9-719cd38a97ef with identifier: XN62659
2026-03-28 18:32:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643c420a-25fc-5e55-bca9-719cd38a97ef with identifier: XN62659 to the API
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:05:08Z',
 'fuel_type': 'diesel',
 'id': '643c420a-25fc-5e55-bca9-719cd38a97ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN62659',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 70879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Trendline BlueMotion',
 'year': 2019}
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN62659%27 HTTP/1.1" 200 None
2026-03-28 18:32:50 [auto1.de] INFO: Saving data for XN62659: {'auction_closing_time': 1774883108.0, 'created_time': 1773467992.119272, 'last_price_update_time': 1774722770.34857}
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN62659') HTTP/1.1" 204 0
2026-03-28 18:32:50 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY07773%27 HTTP/1.1" 200 None
2026-03-28 18:32:50 [auto1.de] INFO: Scrape type for NY07773: 0
2026-03-28 18:32:50 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64995%27 HTTP/1.1" 200 None
2026-03-28 18:32:50 [auto1.de] INFO: Scrape type for FT64995: 0
2026-03-28 18:32:50 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-28 18:32:50 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW81308%27 HTTP/1.1" 200 None
2026-03-28 18:32:50 [auto1.de] INFO: Scrape type for HW81308: 0
2026-03-28 18:32:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:51 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 5994 | hits on page: 40
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX03008%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for TX03008: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU22690%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for AU22690: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC27977%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for MC27977: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ76690%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for RJ76690: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN57570%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for DN57570: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK33721%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for BK33721: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ55484%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for HJ55484: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC81369%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for CC81369: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD33755%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for PD33755: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP88862%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for RP88862: 0
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-28 18:32:51 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-28 18:32:51 [auto1.de] INFO: Scrape type for ZT00838: 2
2026-03-28 18:32:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with identifier: ZT00838
2026-03-28 18:32:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with scrape type 2
2026-03-28 18:32:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with scrape type 2
2026-03-28 18:32:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d2d3ce8-d539-5ed0-b526-b18f142188d8, identifier: ZT00838
2026-03-28 18:32:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with identifier: ZT00838
2026-03-28 18:32:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with identifier: ZT00838
2026-03-28 18:32:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d2d3ce8-d539-5ed0-b526-b18f142188d8 with identifier: ZT00838 to the API
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:03:22Z',
 'fuel_type': 'diesel',
 'id': '6d2d3ce8-d539-5ed0-b526-b18f142188d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT00838',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 177313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-17',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00838%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Saving data for ZT00838: {'auction_closing_time': 1774883002.0, 'created_time': 1774521727.821875, 'last_price_update_time': 1774722772.099816}
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT00838') HTTP/1.1" 204 0
2026-03-28 18:32:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC03067%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Scrape type for GC03067: 0
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR03591%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Scrape type for UR03591: 0
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW48006%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Scrape type for LW48006: 0
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU86214%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Scrape type for MU86214: 0
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE80125%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Scrape type for HE80125: 0
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Scrape type for VL45063: 2
2026-03-28 18:32:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with identifier: VL45063
2026-03-28 18:32:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with scrape type 2
2026-03-28 18:32:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with scrape type 2
2026-03-28 18:32:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d, identifier: VL45063
2026-03-28 18:32:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with identifier: VL45063
2026-03-28 18:32:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with identifier: VL45063
2026-03-28 18:32:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d with identifier: VL45063 to the API
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:27:10Z',
 'fuel_type': 'diesel',
 'id': 'ac0a17a1-001b-5f1b-a0d2-e7fd4bce240d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL45063',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 222273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-22',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2012}
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL45063%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Saving data for VL45063: {'auction_closing_time': 1774884430.0, 'created_time': 1774636362.664369, 'last_price_update_time': 1774722772.733093}
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL45063') HTTP/1.1" 204 0
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX88340%27 HTTP/1.1" 200 None
2026-03-28 18:32:52 [auto1.de] INFO: Scrape type for FX88340: 0
2026-03-28 18:32:52 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-28 18:32:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:53 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 5994 | hits on page: 40
2026-03-28 18:32:53 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-28 18:32:53 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-28 18:32:53 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-28 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45065%27 HTTP/1.1" 200 None
2026-03-28 18:32:53 [auto1.de] INFO: Scrape type for SZ45065: 0
2026-03-28 18:32:53 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-28 18:32:53 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-28 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-28 18:32:53 [auto1.de] INFO: Scrape type for DF33717: 2
2026-03-28 18:32:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b31b3d-8574-519b-9c6b-ac57280a7aba with identifier: DF33717
2026-03-28 18:32:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b31b3d-8574-519b-9c6b-ac57280a7aba with scrape type 2
2026-03-28 18:32:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b31b3d-8574-519b-9c6b-ac57280a7aba with scrape type 2
2026-03-28 18:32:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15b31b3d-8574-519b-9c6b-ac57280a7aba, identifier: DF33717
2026-03-28 18:32:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15b31b3d-8574-519b-9c6b-ac57280a7aba with identifier: DF33717
2026-03-28 18:32:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15b31b3d-8574-519b-9c6b-ac57280a7aba with identifier: DF33717
2026-03-28 18:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15b31b3d-8574-519b-9c6b-ac57280a7aba with identifier: DF33717 to the API
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:20:07Z',
 'fuel_type': 'petrol',
 'id': '15b31b3d-8574-519b-9c6b-ac57280a7aba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF33717',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 15693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-17',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF33717%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Saving data for DF33717: {'auction_closing_time': 1774884007.0, 'created_time': 1774117862.39839, 'last_price_update_time': 1774722774.27576}
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF33717') HTTP/1.1" 204 0
2026-03-28 18:32:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ96114%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for RJ96114: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA19754%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for PA19754: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for MP68485: 2
2026-03-28 18:32:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8ac424c-007c-5e91-b969-bde01a549264 with identifier: MP68485
2026-03-28 18:32:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8ac424c-007c-5e91-b969-bde01a549264 with scrape type 2
2026-03-28 18:32:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8ac424c-007c-5e91-b969-bde01a549264 with scrape type 2
2026-03-28 18:32:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8ac424c-007c-5e91-b969-bde01a549264, identifier: MP68485
2026-03-28 18:32:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8ac424c-007c-5e91-b969-bde01a549264 with identifier: MP68485
2026-03-28 18:32:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8ac424c-007c-5e91-b969-bde01a549264 with identifier: MP68485
2026-03-28 18:32:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8ac424c-007c-5e91-b969-bde01a549264 with identifier: MP68485 to the API
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:45:15Z',
 'fuel_type': 'diesel',
 'id': 'c8ac424c-007c-5e91-b969-bde01a549264',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP68485',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 191271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-14',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP68485%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Saving data for MP68485: {'auction_closing_time': 1774885515.0, 'created_time': 1773224073.49372, 'last_price_update_time': 1774722774.857513}
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP68485') HTTP/1.1" 204 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR18256%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for XR18256: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27590%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for PE27590: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ53185%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for BZ53185: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR34750%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for KR34750: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC40686%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for FC40686: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK90635%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for WK90635: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: US02373
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02373%27 HTTP/1.1" 200 None
2026-03-28 18:32:54 [auto1.de] INFO: Scrape type for US02373: 0
2026-03-28 18:32:54 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-28 18:32:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:55 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 5995 | hits on page: 40
2026-03-28 18:32:55 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-28 18:32:55 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-28 18:32:55 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-28 18:32:55 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-28 18:32:55 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-28 18:32:55 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-28 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22458%27 HTTP/1.1" 200 None
2026-03-28 18:32:55 [auto1.de] INFO: Scrape type for ZW22458: 0
2026-03-28 18:32:55 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-28 18:32:55 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-28 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-28 18:32:55 [auto1.de] INFO: Scrape type for XY67074: 2
2026-03-28 18:32:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48de0a42-a8d8-561e-896d-17fc885f5f7b with identifier: XY67074
2026-03-28 18:32:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48de0a42-a8d8-561e-896d-17fc885f5f7b with scrape type 2
2026-03-28 18:32:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48de0a42-a8d8-561e-896d-17fc885f5f7b with scrape type 2
2026-03-28 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48de0a42-a8d8-561e-896d-17fc885f5f7b, identifier: XY67074
2026-03-28 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48de0a42-a8d8-561e-896d-17fc885f5f7b with identifier: XY67074
2026-03-28 18:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48de0a42-a8d8-561e-896d-17fc885f5f7b with identifier: XY67074
2026-03-28 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48de0a42-a8d8-561e-896d-17fc885f5f7b with identifier: XY67074 to the API
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:32Z',
 'fuel_type': 'diesel',
 'id': '48de0a42-a8d8-561e-896d-17fc885f5f7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY67074',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 74831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TDI IQ.DRIVE',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY67074%27 HTTP/1.1" 200 None
2026-03-28 18:32:56 [auto1.de] INFO: Saving data for XY67074: {'auction_closing_time': 1774886312.0, 'created_time': 1774636271.056754, 'last_price_update_time': 1774722776.308066}
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY67074') HTTP/1.1" 204 0
2026-03-28 18:32:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:56 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-28 18:32:56 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA95549%27 HTTP/1.1" 200 None
2026-03-28 18:32:56 [auto1.de] INFO: Scrape type for KA95549: 0
2026-03-28 18:32:56 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-28 18:32:56 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-28 18:32:56 [auto1.de] INFO: Scrape type for XT00440: 2
2026-03-28 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with identifier: XT00440
2026-03-28 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with scrape type 2
2026-03-28 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with scrape type 2
2026-03-28 18:32:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89, identifier: XT00440
2026-03-28 18:32:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with identifier: XT00440
2026-03-28 18:32:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with identifier: XT00440
2026-03-28 18:32:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1451e1b7-7aa0-5e12-b7ed-2adb52534f89 with identifier: XT00440 to the API
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:32Z',
 'fuel_type': 'diesel',
 'id': '1451e1b7-7aa0-5e12-b7ed-2adb52534f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT00440',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60 Cross Country',
 'odometer': 145271,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-28',
 'seller_name': None,
 'title': 'Volvo V60 Cross Country 2.0 D4 Plus',
 'transmission': 'automatic',
 'trim': 'Plus',
 'year': 2018}
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT00440%27 HTTP/1.1" 200 None
2026-03-28 18:32:56 [auto1.de] INFO: Saving data for XT00440: {'auction_closing_time': 1774884452.0, 'created_time': 1774522460.119664, 'last_price_update_time': 1774722776.850716}
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT00440') HTTP/1.1" 204 0
2026-03-28 18:32:56 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP85983%27 HTTP/1.1" 200 None
2026-03-28 18:32:56 [auto1.de] INFO: Scrape type for DP85983: 0
2026-03-28 18:32:56 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-28 18:32:56 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-28 18:32:56 [auto1.de] INFO: Scrape type for DL51973: 2
2026-03-28 18:32:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 555db34b-10da-5740-8367-a7dd8e258314 with identifier: DL51973
2026-03-28 18:32:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 555db34b-10da-5740-8367-a7dd8e258314 with scrape type 2
2026-03-28 18:32:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 555db34b-10da-5740-8367-a7dd8e258314 with scrape type 2
2026-03-28 18:32:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 555db34b-10da-5740-8367-a7dd8e258314, identifier: DL51973
2026-03-28 18:32:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 555db34b-10da-5740-8367-a7dd8e258314 with identifier: DL51973
2026-03-28 18:32:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 555db34b-10da-5740-8367-a7dd8e258314 with identifier: DL51973
2026-03-28 18:32:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 555db34b-10da-5740-8367-a7dd8e258314 with identifier: DL51973 to the API
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:15:53Z',
 'fuel_type': 'diesel',
 'id': '555db34b-10da-5740-8367-a7dd8e258314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL51973',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 149221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL51973%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Saving data for DL51973: {'auction_closing_time': 1774883753.0, 'created_time': 1773945616.111751, 'last_price_update_time': 1774722777.29992}
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL51973') HTTP/1.1" 204 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG27437%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for CG27437: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE91712%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for UE91712: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW13122%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for FW13122: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW23111%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for SW23111: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ30367%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for VJ30367: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC27569%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for BC27569: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM91715%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for RM91715: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT94626%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for JT94626: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS86006%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for KS86006: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82914%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for MH82914: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ08427%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for UZ08427: 0
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-28 18:32:57 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF60599%27 HTTP/1.1" 200 None
2026-03-28 18:32:57 [auto1.de] INFO: Scrape type for BF60599: 0
2026-03-28 18:32:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:32:58 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 5995 | hits on page: 40
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG83893%27 HTTP/1.1" 200 None
2026-03-28 18:32:58 [auto1.de] INFO: Scrape type for YG83893: 0
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ12441%27 HTTP/1.1" 200 None
2026-03-28 18:32:58 [auto1.de] INFO: Scrape type for WJ12441: 0
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS82829%27 HTTP/1.1" 200 None
2026-03-28 18:32:58 [auto1.de] INFO: Scrape type for NS82829: 0
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-28 18:32:58 [auto1.de] INFO: Scrape type for EN23227: 2
2026-03-28 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with identifier: EN23227
2026-03-28 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with scrape type 2
2026-03-28 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with scrape type 2
2026-03-28 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7fdc29f-84d4-502d-ba1b-2715ea68fff5, identifier: EN23227
2026-03-28 18:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with identifier: EN23227
2026-03-28 18:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with identifier: EN23227
2026-03-28 18:32:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7fdc29f-84d4-502d-ba1b-2715ea68fff5 with identifier: EN23227 to the API
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:13Z',
 'fuel_type': 'diesel',
 'id': 'f7fdc29f-84d4-502d-ba1b-2715ea68fff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN23227',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Captiva',
 'odometer': 227738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-08',
 'seller_name': None,
 'title': 'Chevrolet Captiva 2.0 Diesel D LT 4WD',
 'transmission': 'automatic',
 'trim': 'D LT 4WD',
 'year': 2008}
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN23227%27 HTTP/1.1" 200 None
2026-03-28 18:32:58 [auto1.de] INFO: Saving data for EN23227: {'auction_closing_time': 1774884193.0, 'created_time': 1774521295.552773, 'last_price_update_time': 1774722778.721087}
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN23227') HTTP/1.1" 204 0
2026-03-28 18:32:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-28 18:32:58 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-28 18:32:58 [auto1.de] INFO: Scrape type for DN49518: 2
2026-03-28 18:32:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25d993b7-e3a1-5b3f-a847-cbcecf935967 with identifier: DN49518
2026-03-28 18:32:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25d993b7-e3a1-5b3f-a847-cbcecf935967 with scrape type 2
2026-03-28 18:32:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25d993b7-e3a1-5b3f-a847-cbcecf935967 with scrape type 2
2026-03-28 18:32:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25d993b7-e3a1-5b3f-a847-cbcecf935967, identifier: DN49518
2026-03-28 18:32:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25d993b7-e3a1-5b3f-a847-cbcecf935967 with identifier: DN49518
2026-03-28 18:32:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25d993b7-e3a1-5b3f-a847-cbcecf935967 with identifier: DN49518
2026-03-28 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25d993b7-e3a1-5b3f-a847-cbcecf935967 with identifier: DN49518 to the API
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:51Z',
 'fuel_type': 'petrol',
 'id': '25d993b7-e3a1-5b3f-a847-cbcecf935967',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN49518',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 130853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-31',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2013}
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN49518%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Saving data for DN49518: {'auction_closing_time': 1774883751.0, 'created_time': 1774636272.491414, 'last_price_update_time': 1774722779.22077}
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN49518') HTTP/1.1" 204 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: US46384
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US46384%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for US46384: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85584%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for XB85584: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA04600%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for RA04600: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN16879%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for BN16879: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG55591%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for JG55591: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ55553%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for PJ55553: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for YH66607: 2
2026-03-28 18:32:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with identifier: YH66607
2026-03-28 18:32:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with scrape type 2
2026-03-28 18:32:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with scrape type 2
2026-03-28 18:32:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc7854a1-9a34-5262-ab8e-f74c486c3ad9, identifier: YH66607
2026-03-28 18:32:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with identifier: YH66607
2026-03-28 18:32:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with identifier: YH66607
2026-03-28 18:32:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc7854a1-9a34-5262-ab8e-f74c486c3ad9 with identifier: YH66607 to the API
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:32:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:12:57Z',
 'fuel_type': 'diesel',
 'id': 'dc7854a1-9a34-5262-ab8e-f74c486c3ad9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH66607',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 116096,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH66607%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Saving data for YH66607: {'auction_closing_time': 1774883577.0, 'created_time': 1774636310.22971, 'last_price_update_time': 1774722779.783924}
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH66607') HTTP/1.1" 204 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR53064%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for WR53064: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU29174%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for VU29174: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN95717%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for SN95717: 0
2026-03-28 18:32:59 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:32:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD12559%27 HTTP/1.1" 200 None
2026-03-28 18:32:59 [auto1.de] INFO: Scrape type for BD12559: 0
2026-03-28 18:33:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:00 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC56654%27 HTTP/1.1" 200 None
2026-03-28 18:33:00 [auto1.de] INFO: Scrape type for MC56654: 0
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC10304%27 HTTP/1.1" 200 None
2026-03-28 18:33:00 [auto1.de] INFO: Scrape type for SC10304: 0
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY95441%27 HTTP/1.1" 200 None
2026-03-28 18:33:00 [auto1.de] INFO: Scrape type for UY95441: 0
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY56514%27 HTTP/1.1" 200 None
2026-03-28 18:33:00 [auto1.de] INFO: Scrape type for CY56514: 0
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK43665%27 HTTP/1.1" 200 None
2026-03-28 18:33:00 [auto1.de] INFO: Scrape type for DK43665: 0
2026-03-28 18:33:00 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-28 18:33:00 [auto1.de] INFO: Scrape type for HZ88582: 2
2026-03-28 18:33:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb940b5b-3f0d-5733-94c5-107d086c65f2 with identifier: HZ88582
2026-03-28 18:33:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb940b5b-3f0d-5733-94c5-107d086c65f2 with scrape type 2
2026-03-28 18:33:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb940b5b-3f0d-5733-94c5-107d086c65f2 with scrape type 2
2026-03-28 18:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb940b5b-3f0d-5733-94c5-107d086c65f2, identifier: HZ88582
2026-03-28 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb940b5b-3f0d-5733-94c5-107d086c65f2 with identifier: HZ88582
2026-03-28 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb940b5b-3f0d-5733-94c5-107d086c65f2 with identifier: HZ88582
2026-03-28 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb940b5b-3f0d-5733-94c5-107d086c65f2 with identifier: HZ88582 to the API
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:50:56Z',
 'fuel_type': 'petrol',
 'id': 'fb940b5b-3f0d-5733-94c5-107d086c65f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ88582',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 119716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-08',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.0 SCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ88582%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Saving data for HZ88582: {'auction_closing_time': 1774885856.0, 'created_time': 1774521253.893274, 'last_price_update_time': 1774722781.428013}
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ88582') HTTP/1.1" 204 0
2026-03-28 18:33:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: US51436
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US51436%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for US51436: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX83628%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for XX83628: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU13341%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for DU13341: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: FP14792
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB22696%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for EB22696: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY82930%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for TY82930: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC35007%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for NC35007: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT04304%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for YT04304: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW44796%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for SW44796: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB73401%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for BB73401: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM92815%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for XM92815: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48150%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for WP48150: 0
2026-03-28 18:33:01 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-28 18:33:01 [auto1.de] INFO: Scrape type for GE16975: 2
2026-03-28 18:33:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a67609b7-36df-53c9-9052-25e72866b3ea with identifier: GE16975
2026-03-28 18:33:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a67609b7-36df-53c9-9052-25e72866b3ea with scrape type 2
2026-03-28 18:33:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a67609b7-36df-53c9-9052-25e72866b3ea with scrape type 2
2026-03-28 18:33:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a67609b7-36df-53c9-9052-25e72866b3ea, identifier: GE16975
2026-03-28 18:33:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a67609b7-36df-53c9-9052-25e72866b3ea with identifier: GE16975
2026-03-28 18:33:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a67609b7-36df-53c9-9052-25e72866b3ea with identifier: GE16975
2026-03-28 18:33:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a67609b7-36df-53c9-9052-25e72866b3ea with identifier: GE16975 to the API
2026-03-28 18:33:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:09:22Z',
 'fuel_type': 'diesel',
 'id': 'a67609b7-36df-53c9-9052-25e72866b3ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE16975',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 214100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16975%27 HTTP/1.1" 200 None
2026-03-28 18:33:02 [auto1.de] INFO: Saving data for GE16975: {'auction_closing_time': 1774883362.0, 'created_time': 1773945809.138602, 'last_price_update_time': 1774722782.119716}
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE16975') HTTP/1.1" 204 0
2026-03-28 18:33:02 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-28 18:33:02 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP27245%27 HTTP/1.1" 200 None
2026-03-28 18:33:02 [auto1.de] INFO: Scrape type for KP27245: 0
2026-03-28 18:33:02 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-28 18:33:02 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-28 18:33:02 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH25051%27 HTTP/1.1" 200 None
2026-03-28 18:33:02 [auto1.de] INFO: Scrape type for CH25051: 0
2026-03-28 18:33:02 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-28 18:33:02 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-28 18:33:02 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL21879%27 HTTP/1.1" 200 None
2026-03-28 18:33:02 [auto1.de] INFO: Scrape type for VL21879: 0
2026-03-28 18:33:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:03 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM46431%27 HTTP/1.1" 200 None
2026-03-28 18:33:03 [auto1.de] INFO: Scrape type for YM46431: 0
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX44500%27 HTTP/1.1" 200 None
2026-03-28 18:33:03 [auto1.de] INFO: Scrape type for UX44500: 0
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-28 18:33:03 [auto1.de] INFO: Scrape type for FJ40863: 1
2026-03-28 18:33:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-28 18:33:03 [auto1.de] INFO: Scrape type for YH78241: 2
2026-03-28 18:33:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 239053f6-93a7-5268-9789-3b3e4aa4fb22 with identifier: YH78241
2026-03-28 18:33:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 239053f6-93a7-5268-9789-3b3e4aa4fb22 with scrape type 2
2026-03-28 18:33:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 239053f6-93a7-5268-9789-3b3e4aa4fb22 with scrape type 2
2026-03-28 18:33:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 239053f6-93a7-5268-9789-3b3e4aa4fb22, identifier: YH78241
2026-03-28 18:33:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 239053f6-93a7-5268-9789-3b3e4aa4fb22 with identifier: YH78241
2026-03-28 18:33:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 239053f6-93a7-5268-9789-3b3e4aa4fb22 with identifier: YH78241
2026-03-28 18:33:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 239053f6-93a7-5268-9789-3b3e4aa4fb22 with identifier: YH78241 to the API
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:59:50Z',
 'fuel_type': 'diesel',
 'id': '239053f6-93a7-5268-9789-3b3e4aa4fb22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH78241',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 279421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-28',
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH78241%27 HTTP/1.1" 200 None
2026-03-28 18:33:03 [auto1.de] INFO: Saving data for YH78241: {'auction_closing_time': 1774886390.0, 'created_time': 1774521310.149287, 'last_price_update_time': 1774722783.883978}
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH78241') HTTP/1.1" 204 0
2026-03-28 18:33:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:03 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY93616%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for DY93616: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH98635%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for EH98635: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC55610%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for BC55610: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for NC31400: 2
2026-03-28 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e064e9b9-666e-59fc-83ef-82a202ea0e1b with identifier: NC31400
2026-03-28 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e064e9b9-666e-59fc-83ef-82a202ea0e1b with scrape type 2
2026-03-28 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e064e9b9-666e-59fc-83ef-82a202ea0e1b with scrape type 2
2026-03-28 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e064e9b9-666e-59fc-83ef-82a202ea0e1b, identifier: NC31400
2026-03-28 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e064e9b9-666e-59fc-83ef-82a202ea0e1b with identifier: NC31400
2026-03-28 18:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e064e9b9-666e-59fc-83ef-82a202ea0e1b with identifier: NC31400
2026-03-28 18:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e064e9b9-666e-59fc-83ef-82a202ea0e1b with identifier: NC31400 to the API
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:24:23Z',
 'fuel_type': 'petrol',
 'id': 'e064e9b9-666e-59fc-83ef-82a202ea0e1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC31400',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 59138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-26',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC31400%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Saving data for NC31400: {'auction_closing_time': 1774884263.0, 'created_time': 1773399757.254423, 'last_price_update_time': 1774722784.48662}
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC31400') HTTP/1.1" 204 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH00472%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for XH00472: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH36335%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for VH36335: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK30866%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for ZK30866: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR31209%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for YR31209: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK07133%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for CK07133: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN56098%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for CN56098: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB85775%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for GB85775: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA06109%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for SA06109: 0
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-28 18:33:04 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-28 18:33:04 [auto1.de] INFO: Scrape type for VA96509: 2
2026-03-28 18:33:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with identifier: VA96509
2026-03-28 18:33:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with scrape type 2
2026-03-28 18:33:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with scrape type 2
2026-03-28 18:33:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8, identifier: VA96509
2026-03-28 18:33:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with identifier: VA96509
2026-03-28 18:33:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with identifier: VA96509
2026-03-28 18:33:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8 with identifier: VA96509 to the API
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:10:08Z',
 'fuel_type': 'petrol',
 'id': 'd705f2c3-c6a9-5d4b-8229-0dd1a9a1c5a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA96509',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Tiida',
 'odometer': 112413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-27',
 'seller_name': None,
 'title': 'Nissan Tiida 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2010}
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA96509%27 HTTP/1.1" 200 None
2026-03-28 18:33:05 [auto1.de] INFO: Saving data for VA96509: {'auction_closing_time': 1774883408.0, 'created_time': 1774089136.462645, 'last_price_update_time': 1774722785.096436}
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VA96509') HTTP/1.1" 204 0
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX02497%27 HTTP/1.1" 200 None
2026-03-28 18:33:05 [auto1.de] INFO: Scrape type for PX02497: 0
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV46830%27 HTTP/1.1" 200 None
2026-03-28 18:33:05 [auto1.de] INFO: Scrape type for LV46830: 0
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-28 18:33:05 [auto1.de] INFO: Scrape type for HU76899: 1
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-28 18:33:05 [auto1.de] INFO: Scrape type for GG35295: 2
2026-03-28 18:33:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 124b1db6-dc95-505c-8d3b-c871addd4150 with identifier: GG35295
2026-03-28 18:33:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 124b1db6-dc95-505c-8d3b-c871addd4150 with scrape type 2
2026-03-28 18:33:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 124b1db6-dc95-505c-8d3b-c871addd4150 with scrape type 2
2026-03-28 18:33:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 124b1db6-dc95-505c-8d3b-c871addd4150, identifier: GG35295
2026-03-28 18:33:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 124b1db6-dc95-505c-8d3b-c871addd4150 with identifier: GG35295
2026-03-28 18:33:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 124b1db6-dc95-505c-8d3b-c871addd4150 with identifier: GG35295
2026-03-28 18:33:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 124b1db6-dc95-505c-8d3b-c871addd4150 with identifier: GG35295 to the API
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:53:41Z',
 'fuel_type': 'diesel',
 'id': '124b1db6-dc95-505c-8d3b-c871addd4150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG35295',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 90402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-29',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Trailhawk',
 'transmission': 'automatic',
 'trim': 'Trailhawk',
 'year': 2018}
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG35295%27 HTTP/1.1" 200 None
2026-03-28 18:33:05 [auto1.de] INFO: Saving data for GG35295: {'auction_closing_time': 1774886021.0, 'created_time': 1774521156.456089, 'last_price_update_time': 1774722785.67605}
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG35295') HTTP/1.1" 204 0
2026-03-28 18:33:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU24928%27 HTTP/1.1" 200 None
2026-03-28 18:33:05 [auto1.de] INFO: Scrape type for AU24928: 0
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-28 18:33:05 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB74696%27 HTTP/1.1" 200 None
2026-03-28 18:33:05 [auto1.de] INFO: Scrape type for NB74696: 0
2026-03-28 18:33:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:06 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM85964%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for XM85964: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV07676%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for EV07676: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT79830%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for TT79830: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW20402%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for DW20402: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ76765%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for BJ76765: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ05854%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for RJ05854: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ09190%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for LZ09190: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06034%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for AU06034: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM64010%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for LM64010: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU34226%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for BU34226: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB30141%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for DB30141: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG01306%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for KG01306: 0
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for GW76676: 2
2026-03-28 18:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce9c10b4-f803-5e3a-b658-9228ab327344 with identifier: GW76676
2026-03-28 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce9c10b4-f803-5e3a-b658-9228ab327344 with scrape type 2
2026-03-28 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce9c10b4-f803-5e3a-b658-9228ab327344 with scrape type 2
2026-03-28 18:33:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce9c10b4-f803-5e3a-b658-9228ab327344, identifier: GW76676
2026-03-28 18:33:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce9c10b4-f803-5e3a-b658-9228ab327344 with identifier: GW76676
2026-03-28 18:33:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce9c10b4-f803-5e3a-b658-9228ab327344 with identifier: GW76676
2026-03-28 18:33:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce9c10b4-f803-5e3a-b658-9228ab327344 with identifier: GW76676 to the API
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:29:01Z',
 'fuel_type': 'petrol',
 'id': 'ce9c10b4-f803-5e3a-b658-9228ab327344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW76676',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 128247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-22',
 'seller_name': None,
 'title': 'Opel Astra 1.8 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW76676%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Saving data for GW76676: {'auction_closing_time': 1774884541.0, 'created_time': 1774032510.565219, 'last_price_update_time': 1774722786.81575}
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW76676') HTTP/1.1" 204 0
2026-03-28 18:33:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-28 18:33:06 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-28 18:33:06 [auto1.de] INFO: Scrape type for NZ56847: 2
2026-03-28 18:33:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4efbd51-0d30-54a2-b9dc-5d1c475a817a with identifier: NZ56847
2026-03-28 18:33:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4efbd51-0d30-54a2-b9dc-5d1c475a817a with scrape type 2
2026-03-28 18:33:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4efbd51-0d30-54a2-b9dc-5d1c475a817a with scrape type 2
2026-03-28 18:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4efbd51-0d30-54a2-b9dc-5d1c475a817a, identifier: NZ56847
2026-03-28 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4efbd51-0d30-54a2-b9dc-5d1c475a817a with identifier: NZ56847
2026-03-28 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4efbd51-0d30-54a2-b9dc-5d1c475a817a with identifier: NZ56847
2026-03-28 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4efbd51-0d30-54a2-b9dc-5d1c475a817a with identifier: NZ56847 to the API
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:36:09Z',
 'fuel_type': 'diesel',
 'id': 'c4efbd51-0d30-54a2-b9dc-5d1c475a817a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ56847',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 205615,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-04',
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ56847%27 HTTP/1.1" 200 None
2026-03-28 18:33:07 [auto1.de] INFO: Saving data for NZ56847: {'auction_closing_time': 1774884969.0, 'created_time': 1774522455.588947, 'last_price_update_time': 1774722787.339258}
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ56847') HTTP/1.1" 204 0
2026-03-28 18:33:07 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-28 18:33:07 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-28 18:33:07 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-28 18:33:07 [auto1.de] INFO: Scrape type for VS80969: 2
2026-03-28 18:33:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e873d094-6967-5652-b3b9-68ce20f5e07b with identifier: VS80969
2026-03-28 18:33:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e873d094-6967-5652-b3b9-68ce20f5e07b with scrape type 2
2026-03-28 18:33:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e873d094-6967-5652-b3b9-68ce20f5e07b with scrape type 2
2026-03-28 18:33:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e873d094-6967-5652-b3b9-68ce20f5e07b, identifier: VS80969
2026-03-28 18:33:07 [scrapy.extensions.logstats] INFO: Crawled 88 pages (at 23 pages/min), scraped 194 items (at 62 items/min)
2026-03-28 18:33:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-28 18:33:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e873d094-6967-5652-b3b9-68ce20f5e07b with identifier: VS80969
2026-03-28 18:33:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e873d094-6967-5652-b3b9-68ce20f5e07b with identifier: VS80969
2026-03-28 18:33:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e873d094-6967-5652-b3b9-68ce20f5e07b with identifier: VS80969 to the API
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:29:45Z',
 'fuel_type': 'petrol',
 'id': 'e873d094-6967-5652-b3b9-68ce20f5e07b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS80969',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 98651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-09',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Advanced 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Advanced 4Motion BlueMotion',
 'year': 2017}
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS80969%27 HTTP/1.1" 200 None
2026-03-28 18:33:07 [auto1.de] INFO: Saving data for VS80969: {'auction_closing_time': 1774884585.0, 'created_time': 1774522349.335637, 'last_price_update_time': 1774722787.777083}
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS80969') HTTP/1.1" 204 0
2026-03-28 18:33:07 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-28 18:33:07 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-28 18:33:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:08 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE37655%27 HTTP/1.1" 200 None
2026-03-28 18:33:08 [auto1.de] INFO: Scrape type for GE37655: 0
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS36397%27 HTTP/1.1" 200 None
2026-03-28 18:33:08 [auto1.de] INFO: Scrape type for LS36397: 0
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF67152%27 HTTP/1.1" 200 None
2026-03-28 18:33:08 [auto1.de] INFO: Scrape type for PF67152: 0
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT58518%27 HTTP/1.1" 200 None
2026-03-28 18:33:08 [auto1.de] INFO: Scrape type for YT58518: 0
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: YU69669
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU69669%27 HTTP/1.1" 200 None
2026-03-28 18:33:08 [auto1.de] INFO: Scrape type for YU69669: 0
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT73600%27 HTTP/1.1" 200 None
2026-03-28 18:33:08 [auto1.de] INFO: Scrape type for CT73600: 0
2026-03-28 18:33:08 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-28 18:33:08 [auto1.de] INFO: Scrape type for RN98053: 2
2026-03-28 18:33:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504ea1ca-1802-5737-a8cf-9251b5c33504 with identifier: RN98053
2026-03-28 18:33:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504ea1ca-1802-5737-a8cf-9251b5c33504 with scrape type 2
2026-03-28 18:33:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504ea1ca-1802-5737-a8cf-9251b5c33504 with scrape type 2
2026-03-28 18:33:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 504ea1ca-1802-5737-a8cf-9251b5c33504, identifier: RN98053
2026-03-28 18:33:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 504ea1ca-1802-5737-a8cf-9251b5c33504 with identifier: RN98053
2026-03-28 18:33:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 504ea1ca-1802-5737-a8cf-9251b5c33504 with identifier: RN98053
2026-03-28 18:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 504ea1ca-1802-5737-a8cf-9251b5c33504 with identifier: RN98053 to the API
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:00Z',
 'fuel_type': 'diesel',
 'id': '504ea1ca-1802-5737-a8cf-9251b5c33504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN98053',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 199256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2015}
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN98053%27 HTTP/1.1" 200 None
2026-03-28 18:33:09 [auto1.de] INFO: Saving data for RN98053: {'auction_closing_time': 1774883220.0, 'created_time': 1774521260.985282, 'last_price_update_time': 1774722789.25384}
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN98053') HTTP/1.1" 204 0
2026-03-28 18:33:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:09 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-28 18:33:09 [auto1.de] INFO: Scrape type for XR25495: 2
2026-03-28 18:33:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddcfbe53-7ab9-52f5-98e8-24264328adad with identifier: XR25495
2026-03-28 18:33:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddcfbe53-7ab9-52f5-98e8-24264328adad with scrape type 2
2026-03-28 18:33:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddcfbe53-7ab9-52f5-98e8-24264328adad with scrape type 2
2026-03-28 18:33:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddcfbe53-7ab9-52f5-98e8-24264328adad, identifier: XR25495
2026-03-28 18:33:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddcfbe53-7ab9-52f5-98e8-24264328adad with identifier: XR25495
2026-03-28 18:33:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddcfbe53-7ab9-52f5-98e8-24264328adad with identifier: XR25495
2026-03-28 18:33:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddcfbe53-7ab9-52f5-98e8-24264328adad with identifier: XR25495 to the API
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:13Z',
 'fuel_type': 'petrol',
 'id': 'ddcfbe53-7ab9-52f5-98e8-24264328adad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR25495',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 217507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-21',
 'seller_name': None,
 'title': 'Volkswagen Sharan 1.4 TSI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR25495%27 HTTP/1.1" 200 None
2026-03-28 18:33:09 [auto1.de] INFO: Saving data for XR25495: {'auction_closing_time': 1774883833.0, 'created_time': 1774636314.915874, 'last_price_update_time': 1774722789.916006}
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR25495') HTTP/1.1" 204 0
2026-03-28 18:33:09 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX89038%27 HTTP/1.1" 200 None
2026-03-28 18:33:09 [auto1.de] INFO: Scrape type for GX89038: 0
2026-03-28 18:33:09 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72791%27 HTTP/1.1" 200 None
2026-03-28 18:33:09 [auto1.de] INFO: Scrape type for CK72791: 0
2026-03-28 18:33:09 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB36683%27 HTTP/1.1" 200 None
2026-03-28 18:33:09 [auto1.de] INFO: Scrape type for MB36683: 0
2026-03-28 18:33:09 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-28 18:33:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM72901%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for CM72901: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK97582%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for AK97582: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW79987%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for KW79987: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY42515%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for RY42515: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX09216%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for BX09216: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV39961%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for EV39961: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC48990%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for SC48990: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF45936%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for ZF45936: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW62166%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for MW62166: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK14526%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for GK14526: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC45462%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for SC45462: 0
2026-03-28 18:33:10 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10701%27 HTTP/1.1" 200 None
2026-03-28 18:33:10 [auto1.de] INFO: Scrape type for VY10701: 0
2026-03-28 18:33:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ40863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:11 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP70009%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for TP70009: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74169%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for DJ74169: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD28287%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for AD28287: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ52896%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for DZ52896: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF42457%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for AF42457: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59823%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for NL59823: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY44699%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for PY44699: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY25163%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for FY25163: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN14580%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for TN14580: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC26693%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for SC26693: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG94369%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for NG94369: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for HG94589: 2
2026-03-28 18:33:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dccaca07-a3e0-52e5-b312-6e612b630897 with identifier: HG94589
2026-03-28 18:33:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dccaca07-a3e0-52e5-b312-6e612b630897 with scrape type 2
2026-03-28 18:33:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dccaca07-a3e0-52e5-b312-6e612b630897 with scrape type 2
2026-03-28 18:33:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dccaca07-a3e0-52e5-b312-6e612b630897, identifier: HG94589
2026-03-28 18:33:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dccaca07-a3e0-52e5-b312-6e612b630897 with identifier: HG94589
2026-03-28 18:33:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dccaca07-a3e0-52e5-b312-6e612b630897 with identifier: HG94589
2026-03-28 18:33:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dccaca07-a3e0-52e5-b312-6e612b630897 with identifier: HG94589 to the API
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:08:33Z',
 'fuel_type': 'diesel',
 'id': 'dccaca07-a3e0-52e5-b312-6e612b630897',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG94589',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 273631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-14',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2014}
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG94589%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Saving data for HG94589: {'auction_closing_time': 1774883313.0, 'created_time': 1773945851.309351, 'last_price_update_time': 1774722791.771776}
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG94589') HTTP/1.1" 204 0
2026-03-28 18:33:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB74339%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for GB74339: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR53020%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for AR53020: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY91699%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for WY91699: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM89812%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for LM89812: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA88457%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for PA88457: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE52715%27 HTTP/1.1" 200 None
2026-03-28 18:33:11 [auto1.de] INFO: Scrape type for NE52715: 0
2026-03-28 18:33:11 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-28 18:33:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD06025%27 HTTP/1.1" 200 None
2026-03-28 18:33:12 [auto1.de] INFO: Scrape type for LD06025: 0
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN51512%27 HTTP/1.1" 200 None
2026-03-28 18:33:12 [auto1.de] INFO: Scrape type for XN51512: 0
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU64075%27 HTTP/1.1" 200 None
2026-03-28 18:33:12 [auto1.de] INFO: Scrape type for XU64075: 0
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB27376%27 HTTP/1.1" 200 None
2026-03-28 18:33:12 [auto1.de] INFO: Scrape type for BB27376: 0
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ86105%27 HTTP/1.1" 200 None
2026-03-28 18:33:12 [auto1.de] INFO: Scrape type for YZ86105: 0
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL87064%27 HTTP/1.1" 200 None
2026-03-28 18:33:12 [auto1.de] INFO: Scrape type for TL87064: 0
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-28 18:33:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:12 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR55742%27 HTTP/1.1" 200 None
2026-03-28 18:33:12 [auto1.de] INFO: Scrape type for AR55742: 0
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-28 18:33:12 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK59777%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for BK59777: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP91359%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for HP91359: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF41212%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for VF41212: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF06660%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for HF06660: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY19584%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for WY19584: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG93130%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for WG93130: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT00605%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for CT00605: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN50331%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for EN50331: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ11168%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for PZ11168: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE44185%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for WE44185: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF30454%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for NF30454: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG00412%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for ZG00412: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ37067%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for UZ37067: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL27608%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for SL27608: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA27410%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for JA27410: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR34423%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for VR34423: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ18000%27 HTTP/1.1" 200 None
2026-03-28 18:33:13 [auto1.de] INFO: Scrape type for UZ18000: 0
2026-03-28 18:33:13 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-28 18:33:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:14 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK70882%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for UK70882: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP10059%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for SP10059: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN46305%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for VN46305: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK51641%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for SK51641: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK31212%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for JK31212: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ16115%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for TJ16115: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM03586%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for SM03586: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM08692%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for ZM08692: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY29921%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for MY29921: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN13511%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for UN13511: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61504%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for GD61504: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR75394%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for VR75394: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86111%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for RC86111: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ26035%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for XJ26035: 0
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-28 18:33:14 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-28 18:33:14 [auto1.de] INFO: Scrape type for GH26905: 2
2026-03-28 18:33:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbdaabe3-6e66-5477-b63e-84e78944a4af with identifier: GH26905
2026-03-28 18:33:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbdaabe3-6e66-5477-b63e-84e78944a4af with scrape type 2
2026-03-28 18:33:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbdaabe3-6e66-5477-b63e-84e78944a4af with scrape type 2
2026-03-28 18:33:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbdaabe3-6e66-5477-b63e-84e78944a4af, identifier: GH26905
2026-03-28 18:33:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbdaabe3-6e66-5477-b63e-84e78944a4af with identifier: GH26905
2026-03-28 18:33:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbdaabe3-6e66-5477-b63e-84e78944a4af with identifier: GH26905
2026-03-28 18:33:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbdaabe3-6e66-5477-b63e-84e78944a4af with identifier: GH26905 to the API
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:50:21Z',
 'fuel_type': 'petrol',
 'id': 'cbdaabe3-6e66-5477-b63e-84e78944a4af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH26905',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 80304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2020}
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH26905%27 HTTP/1.1" 200 None
2026-03-28 18:33:15 [auto1.de] INFO: Saving data for GH26905: {'auction_closing_time': 1774885821.0, 'created_time': 1773427149.562784, 'last_price_update_time': 1774722795.262721}
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH26905') HTTP/1.1" 204 0
2026-03-28 18:33:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:15 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-28 18:33:15 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP45415%27 HTTP/1.1" 200 None
2026-03-28 18:33:15 [auto1.de] INFO: Scrape type for GP45415: 0
2026-03-28 18:33:15 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-28 18:33:15 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE22716%27 HTTP/1.1" 200 None
2026-03-28 18:33:15 [auto1.de] INFO: Scrape type for FE22716: 0
2026-03-28 18:33:15 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-28 18:33:15 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-28 18:33:15 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN77653%27 HTTP/1.1" 200 None
2026-03-28 18:33:15 [auto1.de] INFO: Scrape type for YN77653: 0
2026-03-28 18:33:15 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-28 18:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU76899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:16 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:16 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-28 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS57817%27 HTTP/1.1" 200 None
2026-03-28 18:33:16 [auto1.de] INFO: Scrape type for CS57817: 0
2026-03-28 18:33:16 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-28 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU59417%27 HTTP/1.1" 200 None
2026-03-28 18:33:16 [auto1.de] INFO: Scrape type for ZU59417: 0
2026-03-28 18:33:16 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-28 18:33:16 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-28 18:33:16 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-28 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-28 18:33:16 [auto1.de] INFO: Scrape type for DD95746: 2
2026-03-28 18:33:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with identifier: DD95746
2026-03-28 18:33:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with scrape type 2
2026-03-28 18:33:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with scrape type 2
2026-03-28 18:33:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba4d6faf-7794-57b8-aa46-6a2e86217fc1, identifier: DD95746
2026-03-28 18:33:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with identifier: DD95746
2026-03-28 18:33:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with identifier: DD95746
2026-03-28 18:33:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba4d6faf-7794-57b8-aa46-6a2e86217fc1 with identifier: DD95746 to the API
2026-03-28 18:33:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:32:44Z',
 'fuel_type': 'diesel',
 'id': 'ba4d6faf-7794-57b8-aa46-6a2e86217fc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD95746',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 183906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-14',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 HDi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2008}
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD95746%27 HTTP/1.1" 200 None
2026-03-28 18:33:17 [auto1.de] INFO: Saving data for DD95746: {'auction_closing_time': 1774884764.0, 'created_time': 1774522020.987534, 'last_price_update_time': 1774722797.011143}
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD95746') HTTP/1.1" 204 0
2026-03-28 18:33:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:17 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-28 18:33:17 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-28 18:33:17 [auto1.de] INFO: Scrape type for PN07086: 2
2026-03-28 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 964c03a8-0229-5468-9a5f-ec28bd95931c with identifier: PN07086
2026-03-28 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 964c03a8-0229-5468-9a5f-ec28bd95931c with scrape type 2
2026-03-28 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 964c03a8-0229-5468-9a5f-ec28bd95931c with scrape type 2
2026-03-28 18:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 964c03a8-0229-5468-9a5f-ec28bd95931c, identifier: PN07086
2026-03-28 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 964c03a8-0229-5468-9a5f-ec28bd95931c with identifier: PN07086
2026-03-28 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 964c03a8-0229-5468-9a5f-ec28bd95931c with identifier: PN07086
2026-03-28 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 964c03a8-0229-5468-9a5f-ec28bd95931c with identifier: PN07086 to the API
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:18Z',
 'fuel_type': 'petrol',
 'id': '964c03a8-0229-5468-9a5f-ec28bd95931c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN07086',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 52722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2020}
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN07086%27 HTTP/1.1" 200 None
2026-03-28 18:33:17 [auto1.de] INFO: Saving data for PN07086: {'auction_closing_time': 1774884858.0, 'created_time': 1774033885.18282, 'last_price_update_time': 1774722797.539995}
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN07086') HTTP/1.1" 204 0
2026-03-28 18:33:17 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-28 18:33:17 [auto1.de] INFO: Scrape type for ZK33939: 2
2026-03-28 18:33:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59572df7-6846-5744-b8a3-18f3703c3a22 with identifier: ZK33939
2026-03-28 18:33:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59572df7-6846-5744-b8a3-18f3703c3a22 with scrape type 2
2026-03-28 18:33:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59572df7-6846-5744-b8a3-18f3703c3a22 with scrape type 2
2026-03-28 18:33:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 59572df7-6846-5744-b8a3-18f3703c3a22, identifier: ZK33939
2026-03-28 18:33:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 59572df7-6846-5744-b8a3-18f3703c3a22 with identifier: ZK33939
2026-03-28 18:33:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 59572df7-6846-5744-b8a3-18f3703c3a22 with identifier: ZK33939
2026-03-28 18:33:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 59572df7-6846-5744-b8a3-18f3703c3a22 with identifier: ZK33939 to the API
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:25:52Z',
 'fuel_type': 'petrol',
 'id': '59572df7-6846-5744-b8a3-18f3703c3a22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK33939',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 83156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-28',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2008}
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK33939%27 HTTP/1.1" 200 None
2026-03-28 18:33:17 [auto1.de] INFO: Saving data for ZK33939: {'auction_closing_time': 1774884352.0, 'created_time': 1773945660.808408, 'last_price_update_time': 1774722797.973682}
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK33939') HTTP/1.1" 204 0
2026-03-28 18:33:17 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-28 18:33:17 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-28 18:33:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA17140%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Scrape type for SA17140: 0
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Scrape type for RV27706: 2
2026-03-28 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f63d19a2-3a56-5424-a9a8-ffd37e82437e with identifier: RV27706
2026-03-28 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f63d19a2-3a56-5424-a9a8-ffd37e82437e with scrape type 2
2026-03-28 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f63d19a2-3a56-5424-a9a8-ffd37e82437e with scrape type 2
2026-03-28 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f63d19a2-3a56-5424-a9a8-ffd37e82437e, identifier: RV27706
2026-03-28 18:33:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f63d19a2-3a56-5424-a9a8-ffd37e82437e with identifier: RV27706
2026-03-28 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f63d19a2-3a56-5424-a9a8-ffd37e82437e with identifier: RV27706
2026-03-28 18:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f63d19a2-3a56-5424-a9a8-ffd37e82437e with identifier: RV27706 to the API
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:16:41Z',
 'fuel_type': 'diesel',
 'id': 'f63d19a2-3a56-5424-a9a8-ffd37e82437e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV27706',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 382650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-17',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 120 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2006}
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV27706%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Saving data for RV27706: {'auction_closing_time': 1774883801.0, 'created_time': 1773945462.486029, 'last_price_update_time': 1774722798.442633}
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV27706') HTTP/1.1" 204 0
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Scrape type for HE21190: 2
2026-03-28 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12692d1e-1eba-53ba-ae46-7cd61805a25c with identifier: HE21190
2026-03-28 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12692d1e-1eba-53ba-ae46-7cd61805a25c with scrape type 2
2026-03-28 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12692d1e-1eba-53ba-ae46-7cd61805a25c with scrape type 2
2026-03-28 18:33:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12692d1e-1eba-53ba-ae46-7cd61805a25c, identifier: HE21190
2026-03-28 18:33:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12692d1e-1eba-53ba-ae46-7cd61805a25c with identifier: HE21190
2026-03-28 18:33:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12692d1e-1eba-53ba-ae46-7cd61805a25c with identifier: HE21190
2026-03-28 18:33:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12692d1e-1eba-53ba-ae46-7cd61805a25c with identifier: HE21190 to the API
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:53:48Z',
 'fuel_type': 'diesel',
 'id': '12692d1e-1eba-53ba-ae46-7cd61805a25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE21190',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 340663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE21190%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Saving data for HE21190: {'auction_closing_time': 1774886028.0, 'created_time': 1773427394.700474, 'last_price_update_time': 1774722798.878477}
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE21190') HTTP/1.1" 204 0
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: US71241
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US71241%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Scrape type for US71241: 0
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97637%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Scrape type for MY97637: 0
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY49162%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Scrape type for YY49162: 0
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR21224%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Scrape type for JR21224: 0
2026-03-28 18:33:18 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-28 18:33:18 [auto1.de] INFO: Scrape type for HG38928: 2
2026-03-28 18:33:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1ba8c85-2681-5cce-a209-5d5ee797d431 with identifier: HG38928
2026-03-28 18:33:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1ba8c85-2681-5cce-a209-5d5ee797d431 with scrape type 2
2026-03-28 18:33:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1ba8c85-2681-5cce-a209-5d5ee797d431 with scrape type 2
2026-03-28 18:33:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1ba8c85-2681-5cce-a209-5d5ee797d431, identifier: HG38928
2026-03-28 18:33:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1ba8c85-2681-5cce-a209-5d5ee797d431 with identifier: HG38928
2026-03-28 18:33:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1ba8c85-2681-5cce-a209-5d5ee797d431 with identifier: HG38928
2026-03-28 18:33:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1ba8c85-2681-5cce-a209-5d5ee797d431 with identifier: HG38928 to the API
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:27:35Z',
 'fuel_type': 'diesel',
 'id': 'b1ba8c85-2681-5cce-a209-5d5ee797d431',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG38928',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 184302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-12',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG38928%27 HTTP/1.1" 200 None
2026-03-28 18:33:19 [auto1.de] INFO: Saving data for HG38928: {'auction_closing_time': 1774884455.0, 'created_time': 1773946137.082673, 'last_price_update_time': 1774722799.400185}
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG38928') HTTP/1.1" 204 0
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT99615%27 HTTP/1.1" 200 None
2026-03-28 18:33:19 [auto1.de] INFO: Scrape type for JT99615: 0
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF59303%27 HTTP/1.1" 200 None
2026-03-28 18:33:19 [auto1.de] INFO: Scrape type for DF59303: 0
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-28 18:33:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:19 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW56389%27 HTTP/1.1" 200 None
2026-03-28 18:33:19 [auto1.de] INFO: Scrape type for VW56389: 0
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04457%27 HTTP/1.1" 200 None
2026-03-28 18:33:19 [auto1.de] INFO: Scrape type for HM04457: 0
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY33610%27 HTTP/1.1" 200 None
2026-03-28 18:33:19 [auto1.de] INFO: Scrape type for JY33610: 0
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN90928%27 HTTP/1.1" 200 None
2026-03-28 18:33:19 [auto1.de] INFO: Scrape type for EN90928: 0
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-28 18:33:19 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-28 18:33:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH09734%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for LH09734: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG29776%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for KG29776: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU35402%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for MU35402: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB29698%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for RB29698: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV83127%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for ZV83127: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK79873%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for CK79873: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ89661%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for CZ89661: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL73598%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for XL73598: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77478%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for YA77478: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU18213%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for UU18213: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW99572%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for MW99572: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ94843%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for HJ94843: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY56723%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for ZY56723: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW33957%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for BW33957: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU42459%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for ZU42459: 0
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-28 18:33:20 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Scrape type for CW80278: 2
2026-03-28 18:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f7498b0-b528-5310-a1b7-2578b4ad20aa with identifier: CW80278
2026-03-28 18:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f7498b0-b528-5310-a1b7-2578b4ad20aa with scrape type 2
2026-03-28 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f7498b0-b528-5310-a1b7-2578b4ad20aa with scrape type 2
2026-03-28 18:33:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f7498b0-b528-5310-a1b7-2578b4ad20aa, identifier: CW80278
2026-03-28 18:33:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f7498b0-b528-5310-a1b7-2578b4ad20aa with identifier: CW80278
2026-03-28 18:33:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f7498b0-b528-5310-a1b7-2578b4ad20aa with identifier: CW80278
2026-03-28 18:33:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f7498b0-b528-5310-a1b7-2578b4ad20aa with identifier: CW80278 to the API
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:47:11Z',
 'fuel_type': 'petrol',
 'id': '7f7498b0-b528-5310-a1b7-2578b4ad20aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW80278',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 161376,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW80278%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [auto1.de] INFO: Saving data for CW80278: {'auction_closing_time': 1774885631.0, 'created_time': 1774002301.362958, 'last_price_update_time': 1774722800.693655}
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW80278') HTTP/1.1" 204 0
2026-03-28 18:33:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU76899> (referer: https://www.auto1.com/v1/car-details-view/HU76899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with identifier: HU76899
2026-03-28 18:33:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with scrape type 1
2026-03-28 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 52c5b24b-37ea-5fe9-ad64-6ef927a677ee
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_129d6a7debcb9e168a595c31a4449c9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_129d6a7debcb9e168a595c31a4449c9a.jpg already downloaded
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_237ead3b0d006f22b594a8975327ddc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_237ead3b0d006f22b594a8975327ddc4.jpg already downloaded
2026-03-28 18:33:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_7baef05423d7bf3822562f0a54a7eda2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_7baef05423d7bf3822562f0a54a7eda2.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_b25876edb96e27d288706be59b5eb118.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_b25876edb96e27d288706be59b5eb118.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_57c3b2aa2cf83be924c5e9480b9ff718.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_57c3b2aa2cf83be924c5e9480b9ff718.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_7abde0565a0da021ab1044c66aabad8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_7abde0565a0da021ab1044c66aabad8d.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_cd80ddc8a9c6474db22a402186bb3377.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_cd80ddc8a9c6474db22a402186bb3377.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_adb88c958d728251d782ee998eefccec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_adb88c958d728251d782ee998eefccec.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_b8f5b97c2d5ea1a790112bd274a3dd65.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_b8f5b97c2d5ea1a790112bd274a3dd65.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fd7%252Fe4d75d428f0b6fdb90525d94273bd950%252Fpa%252FHU76899_8a07fbc269711898ca9fcfd771d0961f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_8a07fbc269711898ca9fcfd771d0961f.jpg already downloaded
2026-03-28 18:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee, identifier: HU76899
2026-03-28 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with identifier: HU76899
2026-03-28 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with identifier: HU76899
2026-03-28 18:33:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52c5b24b-37ea-5fe9-ad64-6ef927a677ee with identifier: HU76899 to the API
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HU76899>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:18:19Z',
 'fuel_type': 'petrol',
 'id': '52c5b24b-37ea-5fe9-ad64-6ef927a677ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU76899',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 22413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_129d6a7debcb9e168a595c31a4449c9a.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_237ead3b0d006f22b594a8975327ddc4.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_7baef05423d7bf3822562f0a54a7eda2.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_b25876edb96e27d288706be59b5eb118.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_57c3b2aa2cf83be924c5e9480b9ff718.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_7abde0565a0da021ab1044c66aabad8d.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_cd80ddc8a9c6474db22a402186bb3377.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_adb88c958d728251d782ee998eefccec.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_b8f5b97c2d5ea1a790112bd274a3dd65.jpg',
                'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_8a07fbc269711898ca9fcfd771d0961f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3157080,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_129d6a7debcb9e168a595c31a4449c9a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3103296,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_237ead3b0d006f22b594a8975327ddc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3001592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_7baef05423d7bf3822562f0a54a7eda2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2863966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_b25876edb96e27d288706be59b5eb118.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3086924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_57c3b2aa2cf83be924c5e9480b9ff718.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2894540,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_7abde0565a0da021ab1044c66aabad8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_cd80ddc8a9c6474db22a402186bb3377.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_adb88c958d728251d782ee998eefccec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_b8f5b97c2d5ea1a790112bd274a3dd65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52c5b24b-37ea-5fe9-ad64-6ef927a677ee/52c5b24b-37ea-5fe9-ad64-6ef927a677ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/d7/e4d75d428f0b6fdb90525d94273bd950/pa/HU76899_8a07fbc269711898ca9fcfd771d0961f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2023}
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU76899%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [auto1.de] INFO: Saving data for HU76899: {'created_time': 1774722801.549894, 'last_price_update_time': 1774722801.549906, 'auction_closing_time': 1774883899.0}
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU76899') HTTP/1.1" 204 0
2026-03-28 18:33:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ40863> (referer: https://www.auto1.com/v1/car-details-view/FJ40863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with identifier: FJ40863
2026-03-28 18:33:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with scrape type 1
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d67901e-7237-5d95-b2b7-ffd60a9d3a67
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_5af28277f2ab4d7dc5fb7328cd08d688.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_5af28277f2ab4d7dc5fb7328cd08d688.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_1736499875b9405a1918cfca975639ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_1736499875b9405a1918cfca975639ca.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_cdf27476e3b210b0112503eea20ea728.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_cdf27476e3b210b0112503eea20ea728.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_d0afc04b1d7c5044228dec76951d9216.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_d0afc04b1d7c5044228dec76951d9216.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_e5c778b8c5326065ef6862f45da98e7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_e5c778b8c5326065ef6862f45da98e7d.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_20748d842108801e04ebac6832ad5261.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_20748d842108801e04ebac6832ad5261.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_efc1a53767855972391cdcc55549d301.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_efc1a53767855972391cdcc55549d301.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_9adf63ff4472db9b0e12840f0f2c8585.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_9adf63ff4472db9b0e12840f0f2c8585.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_6f14c9a26844621b413e9c869f81e747.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_6f14c9a26844621b413e9c869f81e747.jpg already downloaded
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fc9%252F19c96305f4496018a3458b3472686f83%252Fpa%252FFJ40863_ae49c2b8df84ef35f3efd1df5619f971.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_ae49c2b8df84ef35f3efd1df5619f971.jpg already downloaded
2026-03-28 18:33:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67, identifier: FJ40863
2026-03-28 18:33:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with identifier: FJ40863
2026-03-28 18:33:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with identifier: FJ40863
2026-03-28 18:33:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d67901e-7237-5d95-b2b7-ffd60a9d3a67 with identifier: FJ40863 to the API
2026-03-28 18:33:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FJ40863>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:02:24Z',
 'fuel_type': 'diesel',
 'id': '0d67901e-7237-5d95-b2b7-ffd60a9d3a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': '91VPJ4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ40863',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 305210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_5af28277f2ab4d7dc5fb7328cd08d688.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_1736499875b9405a1918cfca975639ca.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_cdf27476e3b210b0112503eea20ea728.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_d0afc04b1d7c5044228dec76951d9216.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_e5c778b8c5326065ef6862f45da98e7d.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_20748d842108801e04ebac6832ad5261.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_efc1a53767855972391cdcc55549d301.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_9adf63ff4472db9b0e12840f0f2c8585.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_6f14c9a26844621b413e9c869f81e747.jpg',
                'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_ae49c2b8df84ef35f3efd1df5619f971.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_5af28277f2ab4d7dc5fb7328cd08d688.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_1736499875b9405a1918cfca975639ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_cdf27476e3b210b0112503eea20ea728.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_d0afc04b1d7c5044228dec76951d9216.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69598,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_e5c778b8c5326065ef6862f45da98e7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_20748d842108801e04ebac6832ad5261.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_efc1a53767855972391cdcc55549d301.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_9adf63ff4472db9b0e12840f0f2c8585.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_6f14c9a26844621b413e9c869f81e747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d67901e-7237-5d95-b2b7-ffd60a9d3a67/0d67901e-7237-5d95-b2b7-ffd60a9d3a67_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 119070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/c9/19c96305f4496018a3458b3472686f83/pa/FJ40863_ae49c2b8df84ef35f3efd1df5619f971.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-12',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 309 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ40863%27 HTTP/1.1" 200 None
2026-03-28 18:33:22 [auto1.de] INFO: Saving data for FJ40863: {'created_time': 1774722802.292301, 'last_price_update_time': 1774722802.292313, 'auction_closing_time': 1774882944.0}
2026-03-28 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ40863') HTTP/1.1" 204 0
2026-03-28 18:33:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:23 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD60070%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for YD60070: 0
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF67159%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for ZF67159: 0
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA27289%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for CA27289: 0
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD58993%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for XD58993: 0
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for LW43520: 2
2026-03-28 18:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f648146f-81a6-5d32-9c4c-e785b339883d with identifier: LW43520
2026-03-28 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f648146f-81a6-5d32-9c4c-e785b339883d with scrape type 2
2026-03-28 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f648146f-81a6-5d32-9c4c-e785b339883d with scrape type 2
2026-03-28 18:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f648146f-81a6-5d32-9c4c-e785b339883d, identifier: LW43520
2026-03-28 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f648146f-81a6-5d32-9c4c-e785b339883d with identifier: LW43520
2026-03-28 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f648146f-81a6-5d32-9c4c-e785b339883d with identifier: LW43520
2026-03-28 18:33:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f648146f-81a6-5d32-9c4c-e785b339883d with identifier: LW43520 to the API
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-30T15:20:50Z',
 'fuel_type': 'petrol',
 'id': 'f648146f-81a6-5d32-9c4c-e785b339883d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW43520',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 33685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2023}
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW43520%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Saving data for LW43520: {'auction_closing_time': 1774884050.0, 'created_time': 1773469105.092581, 'last_price_update_time': 1774722803.7062}
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW43520') HTTP/1.1" 204 0
2026-03-28 18:33:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP47747%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for WP47747: 0
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR99181%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for WR99181: 0
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME12043%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for ME12043: 0
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD97280%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for SD97280: 0
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-28 18:33:23 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-28 18:33:23 [auto1.de] INFO: Scrape type for ST29936: 2
2026-03-28 18:33:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a1433d5-6377-5255-bb72-e615eac3ab3d with identifier: ST29936
2026-03-28 18:33:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a1433d5-6377-5255-bb72-e615eac3ab3d with scrape type 2
2026-03-28 18:33:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a1433d5-6377-5255-bb72-e615eac3ab3d with scrape type 2
2026-03-28 18:33:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a1433d5-6377-5255-bb72-e615eac3ab3d, identifier: ST29936
2026-03-28 18:33:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a1433d5-6377-5255-bb72-e615eac3ab3d with identifier: ST29936
2026-03-28 18:33:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a1433d5-6377-5255-bb72-e615eac3ab3d with identifier: ST29936
2026-03-28 18:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a1433d5-6377-5255-bb72-e615eac3ab3d with identifier: ST29936 to the API
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:24:39Z',
 'fuel_type': 'petrol',
 'id': '2a1433d5-6377-5255-bb72-e615eac3ab3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST29936',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 130929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 230 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST29936%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Saving data for ST29936: {'auction_closing_time': 1774884279.0, 'created_time': 1773429062.924315, 'last_price_update_time': 1774722804.241147}
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST29936') HTTP/1.1" 204 0
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP02747%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Scrape type for BP02747: 0
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Scrape type for BT37883: 2
2026-03-28 18:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7974582-960f-5013-b4df-96d3b932e76d with identifier: BT37883
2026-03-28 18:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7974582-960f-5013-b4df-96d3b932e76d with scrape type 2
2026-03-28 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7974582-960f-5013-b4df-96d3b932e76d with scrape type 2
2026-03-28 18:33:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7974582-960f-5013-b4df-96d3b932e76d, identifier: BT37883
2026-03-28 18:33:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7974582-960f-5013-b4df-96d3b932e76d with identifier: BT37883
2026-03-28 18:33:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7974582-960f-5013-b4df-96d3b932e76d with identifier: BT37883
2026-03-28 18:33:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7974582-960f-5013-b4df-96d3b932e76d with identifier: BT37883 to the API
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:40:15Z',
 'fuel_type': 'petrol',
 'id': 'c7974582-960f-5013-b4df-96d3b932e76d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT37883',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 232234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-31',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2005}
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT37883%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Saving data for BT37883: {'auction_closing_time': 1774885215.0, 'created_time': 1774118411.2241, 'last_price_update_time': 1774722804.85745}
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT37883') HTTP/1.1" 204 0
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW79588%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Scrape type for VW79588: 0
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX03120%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Scrape type for DX03120: 0
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX04560%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Scrape type for RX04560: 0
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV26342%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Scrape type for FV26342: 0
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-28 18:33:24 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-28 18:33:24 [auto1.de] INFO: Scrape type for UV59464: 2
2026-03-28 18:33:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e36d07-94e8-560a-b8f0-07eae5eb2454 with identifier: UV59464
2026-03-28 18:33:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e36d07-94e8-560a-b8f0-07eae5eb2454 with scrape type 2
2026-03-28 18:33:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e36d07-94e8-560a-b8f0-07eae5eb2454 with scrape type 2
2026-03-28 18:33:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83e36d07-94e8-560a-b8f0-07eae5eb2454, identifier: UV59464
2026-03-28 18:33:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83e36d07-94e8-560a-b8f0-07eae5eb2454 with identifier: UV59464
2026-03-28 18:33:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83e36d07-94e8-560a-b8f0-07eae5eb2454 with identifier: UV59464
2026-03-28 18:33:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83e36d07-94e8-560a-b8f0-07eae5eb2454 with identifier: UV59464 to the API
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:31:23Z',
 'fuel_type': 'petrol',
 'id': '83e36d07-94e8-560a-b8f0-07eae5eb2454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV59464',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Citigo',
 'odometer': 188397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-21',
 'seller_name': None,
 'title': 'Skoda Citigo 1.0 MPI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2015}
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV59464%27 HTTP/1.1" 200 None
2026-03-28 18:33:25 [auto1.de] INFO: Saving data for UV59464: {'auction_closing_time': 1774884683.0, 'created_time': 1774089426.211989, 'last_price_update_time': 1774722805.387964}
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV59464') HTTP/1.1" 204 0
2026-03-28 18:33:25 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS49465%27 HTTP/1.1" 200 None
2026-03-28 18:33:25 [auto1.de] INFO: Scrape type for GS49465: 0
2026-03-28 18:33:25 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-28 18:33:25 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-28 18:33:25 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-28 18:33:25 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-28 18:33:25 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-28 18:33:25 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-28 18:33:25 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF35410%27 HTTP/1.1" 200 None
2026-03-28 18:33:25 [auto1.de] INFO: Scrape type for HF35410: 0
2026-03-28 18:33:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:26 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU97792%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for TU97792: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS53664%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for NS53664: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA44978%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for MA44978: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG52113%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for VG52113: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ51579%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for HZ51579: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY67479%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for GY67479: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ08081%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for VJ08081: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX62190%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for CX62190: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE06888%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for RE06888: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73698%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for WK73698: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83038%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for EE83038: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX72393%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for NX72393: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH26484%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for SH26484: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE92439%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for HE92439: 0
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-28 18:33:26 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-28 18:33:26 [auto1.de] INFO: Scrape type for MM36361: 2
2026-03-28 18:33:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8af8be3-996b-5095-995f-4fd6fd4eb7ed with identifier: MM36361
2026-03-28 18:33:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8af8be3-996b-5095-995f-4fd6fd4eb7ed with scrape type 2
2026-03-28 18:33:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8af8be3-996b-5095-995f-4fd6fd4eb7ed with scrape type 2
2026-03-28 18:33:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8af8be3-996b-5095-995f-4fd6fd4eb7ed, identifier: MM36361
2026-03-28 18:33:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8af8be3-996b-5095-995f-4fd6fd4eb7ed with identifier: MM36361
2026-03-28 18:33:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8af8be3-996b-5095-995f-4fd6fd4eb7ed with identifier: MM36361
2026-03-28 18:33:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8af8be3-996b-5095-995f-4fd6fd4eb7ed with identifier: MM36361 to the API
2026-03-28 18:33:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:29:28Z',
 'fuel_type': 'petrol',
 'id': 'f8af8be3-996b-5095-995f-4fd6fd4eb7ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM36361',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 120980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-09',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.5 Invite',
 'transmission': 'manual',
 'trim': 'Invite',
 'year': 2009}
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM36361%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Saving data for MM36361: {'auction_closing_time': 1774884568.0, 'created_time': 1774032384.58589, 'last_price_update_time': 1774722807.208631}
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM36361') HTTP/1.1" 204 0
2026-03-28 18:33:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN48826%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Scrape type for BN48826: 0
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB96923%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Scrape type for EB96923: 0
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH62706%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Scrape type for VH62706: 0
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ04570%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Scrape type for NZ04570: 0
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC29722%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Scrape type for FC29722: 0
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK03693%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Scrape type for XK03693: 0
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Scrape type for MR61415: 2
2026-03-28 18:33:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b714281-c6a3-50fe-8f8a-7424b8d71064 with identifier: MR61415
2026-03-28 18:33:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b714281-c6a3-50fe-8f8a-7424b8d71064 with scrape type 2
2026-03-28 18:33:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b714281-c6a3-50fe-8f8a-7424b8d71064 with scrape type 2
2026-03-28 18:33:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b714281-c6a3-50fe-8f8a-7424b8d71064, identifier: MR61415
2026-03-28 18:33:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b714281-c6a3-50fe-8f8a-7424b8d71064 with identifier: MR61415
2026-03-28 18:33:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b714281-c6a3-50fe-8f8a-7424b8d71064 with identifier: MR61415
2026-03-28 18:33:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b714281-c6a3-50fe-8f8a-7424b8d71064 with identifier: MR61415 to the API
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:11Z',
 'fuel_type': 'petrol',
 'id': '2b714281-c6a3-50fe-8f8a-7424b8d71064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR61415',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 74528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2019}
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR61415%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Saving data for MR61415: {'auction_closing_time': 1774885691.0, 'created_time': 1773917462.964363, 'last_price_update_time': 1774722807.865232}
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR61415') HTTP/1.1" 204 0
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG34789%27 HTTP/1.1" 200 None
2026-03-28 18:33:27 [auto1.de] INFO: Scrape type for AG34789: 0
2026-03-28 18:33:27 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-28 18:33:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-28 18:33:28 [auto1.de] INFO: Scrape type for SA01659: 2
2026-03-28 18:33:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with identifier: SA01659
2026-03-28 18:33:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with scrape type 2
2026-03-28 18:33:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with scrape type 2
2026-03-28 18:33:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e, identifier: SA01659
2026-03-28 18:33:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with identifier: SA01659
2026-03-28 18:33:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with identifier: SA01659
2026-03-28 18:33:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1854b930-ef1e-5d8f-8eba-69fdb92ebd6e with identifier: SA01659 to the API
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:42:33Z',
 'fuel_type': 'petrol',
 'id': '1854b930-ef1e-5d8f-8eba-69fdb92ebd6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA01659',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 87955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA01659%27 HTTP/1.1" 200 None
2026-03-28 18:33:28 [auto1.de] INFO: Saving data for SA01659: {'auction_closing_time': 1774885353.0, 'created_time': 1774521747.31023, 'last_price_update_time': 1774722808.411039}
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA01659') HTTP/1.1" 204 0
2026-03-28 18:33:28 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP87344%27 HTTP/1.1" 200 None
2026-03-28 18:33:28 [auto1.de] INFO: Scrape type for KP87344: 0
2026-03-28 18:33:28 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL56832%27 HTTP/1.1" 200 None
2026-03-28 18:33:28 [auto1.de] INFO: Scrape type for WL56832: 0
2026-03-28 18:33:28 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-28 18:33:28 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-28 18:33:28 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-28 18:33:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:29 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS57219%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for MS57219: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK29782%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for LK29782: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM51025%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for JM51025: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD39951%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for HD39951: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB20328%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for BB20328: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55927%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for TN55927: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW54456%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for EW54456: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV99140%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for EV99140: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK51404%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for GK51404: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM15631%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for GM15631: 0
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-28 18:33:29 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-28 18:33:29 [auto1.de] INFO: Scrape type for EW11176: 2
2026-03-28 18:33:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with identifier: EW11176
2026-03-28 18:33:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with scrape type 2
2026-03-28 18:33:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with scrape type 2
2026-03-28 18:33:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888, identifier: EW11176
2026-03-28 18:33:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with identifier: EW11176
2026-03-28 18:33:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with identifier: EW11176
2026-03-28 18:33:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c553dbc-0bb9-5aeb-b4f4-c84a9a601888 with identifier: EW11176 to the API
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:21Z',
 'fuel_type': 'diesel',
 'id': '8c553dbc-0bb9-5aeb-b4f4-c84a9a601888',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW11176',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 142170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-29',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW11176%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Saving data for EW11176: {'auction_closing_time': 1774886241.0, 'created_time': 1774522069.285753, 'last_price_update_time': 1774722810.036492}
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW11176') HTTP/1.1" 204 0
2026-03-28 18:33:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG67731%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Scrape type for SG67731: 0
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY52691%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Scrape type for VY52691: 0
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC09309%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Scrape type for PC09309: 0
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG80642%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Scrape type for LG80642: 0
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK79004%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Scrape type for XK79004: 0
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW72462%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Scrape type for RW72462: 0
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Scrape type for MC04391: 2
2026-03-28 18:33:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 383362d7-1699-534d-b2b6-f957b986223d with identifier: MC04391
2026-03-28 18:33:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 383362d7-1699-534d-b2b6-f957b986223d with scrape type 2
2026-03-28 18:33:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 383362d7-1699-534d-b2b6-f957b986223d with scrape type 2
2026-03-28 18:33:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 383362d7-1699-534d-b2b6-f957b986223d, identifier: MC04391
2026-03-28 18:33:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 383362d7-1699-534d-b2b6-f957b986223d with identifier: MC04391
2026-03-28 18:33:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 383362d7-1699-534d-b2b6-f957b986223d with identifier: MC04391
2026-03-28 18:33:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 383362d7-1699-534d-b2b6-f957b986223d with identifier: MC04391 to the API
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:37:34Z',
 'fuel_type': 'diesel',
 'id': '383362d7-1699-534d-b2b6-f957b986223d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC04391',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 148983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-02',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC04391%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Saving data for MC04391: {'auction_closing_time': 1774885054.0, 'created_time': 1774522476.138866, 'last_price_update_time': 1774722810.709661}
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC04391') HTTP/1.1" 204 0
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN24694%27 HTTP/1.1" 200 None
2026-03-28 18:33:30 [auto1.de] INFO: Scrape type for MN24694: 0
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-28 18:33:30 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-28 18:33:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:31 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:31 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-28 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW33862%27 HTTP/1.1" 200 None
2026-03-28 18:33:31 [auto1.de] INFO: Scrape type for AW33862: 0
2026-03-28 18:33:31 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-28 18:33:31 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-28 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-28 18:33:31 [auto1.de] INFO: Scrape type for KE01468: 2
2026-03-28 18:33:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b80dba-e9a1-5418-bb7c-d9e2e14819de with identifier: KE01468
2026-03-28 18:33:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b80dba-e9a1-5418-bb7c-d9e2e14819de with scrape type 2
2026-03-28 18:33:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d7b80dba-e9a1-5418-bb7c-d9e2e14819de with scrape type 2
2026-03-28 18:33:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7b80dba-e9a1-5418-bb7c-d9e2e14819de, identifier: KE01468
2026-03-28 18:33:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7b80dba-e9a1-5418-bb7c-d9e2e14819de with identifier: KE01468
2026-03-28 18:33:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7b80dba-e9a1-5418-bb7c-d9e2e14819de with identifier: KE01468
2026-03-28 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7b80dba-e9a1-5418-bb7c-d9e2e14819de with identifier: KE01468 to the API
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:29:08Z',
 'fuel_type': 'petrol',
 'id': 'd7b80dba-e9a1-5418-bb7c-d9e2e14819de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE01468',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 155750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2015}
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE01468%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Saving data for KE01468: {'auction_closing_time': 1774884548.0, 'created_time': 1774522466.631769, 'last_price_update_time': 1774722812.282833}
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KE01468') HTTP/1.1" 204 0
2026-03-28 18:33:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82171%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Scrape type for PS82171: 0
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS99143%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Scrape type for YS99143: 0
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS03851%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Scrape type for WS03851: 0
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Scrape type for WB36208: 2
2026-03-28 18:33:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61e979c6-c893-5656-b2a7-395ff5039fa5 with identifier: WB36208
2026-03-28 18:33:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61e979c6-c893-5656-b2a7-395ff5039fa5 with scrape type 2
2026-03-28 18:33:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61e979c6-c893-5656-b2a7-395ff5039fa5 with scrape type 2
2026-03-28 18:33:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61e979c6-c893-5656-b2a7-395ff5039fa5, identifier: WB36208
2026-03-28 18:33:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61e979c6-c893-5656-b2a7-395ff5039fa5 with identifier: WB36208
2026-03-28 18:33:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61e979c6-c893-5656-b2a7-395ff5039fa5 with identifier: WB36208
2026-03-28 18:33:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61e979c6-c893-5656-b2a7-395ff5039fa5 with identifier: WB36208 to the API
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:22:56Z',
 'fuel_type': 'petrol',
 'id': '61e979c6-c893-5656-b2a7-395ff5039fa5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB36208',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 439233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-19',
 'seller_name': None,
 'title': 'BMW 5er 530i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB36208%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Saving data for WB36208: {'auction_closing_time': 1774884176.0, 'created_time': 1774636277.738753, 'last_price_update_time': 1774722812.882301}
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB36208') HTTP/1.1" 204 0
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD03873%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Scrape type for LD03873: 0
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA01467%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Scrape type for AA01467: 0
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20233%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Scrape type for XT20233: 0
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK34912%27 HTTP/1.1" 200 None
2026-03-28 18:33:32 [auto1.de] INFO: Scrape type for TK34912: 0
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-28 18:33:32 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71547%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Scrape type for FJ71547: 0
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF63031%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Scrape type for KF63031: 0
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Scrape type for EU22008: 2
2026-03-28 18:33:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with identifier: EU22008
2026-03-28 18:33:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with scrape type 2
2026-03-28 18:33:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with scrape type 2
2026-03-28 18:33:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9, identifier: EU22008
2026-03-28 18:33:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with identifier: EU22008
2026-03-28 18:33:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with identifier: EU22008
2026-03-28 18:33:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08d665d8-c9d1-5eb4-89b1-7a0f16a630c9 with identifier: EU22008 to the API
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:37Z',
 'fuel_type': 'diesel',
 'id': '08d665d8-c9d1-5eb4-89b1-7a0f16a630c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU22008',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 363129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU22008%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Saving data for EU22008: {'auction_closing_time': 1774883857.0, 'created_time': 1774522403.096396, 'last_price_update_time': 1774722813.486697}
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU22008') HTTP/1.1" 204 0
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF55313%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Scrape type for KF55313: 0
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW00779%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Scrape type for UW00779: 0
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE41516%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Scrape type for CE41516: 0
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT47484%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Scrape type for JT47484: 0
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-28 18:33:33 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT39177%27 HTTP/1.1" 200 None
2026-03-28 18:33:33 [auto1.de] INFO: Scrape type for HT39177: 0
2026-03-28 18:33:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:34 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:34 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-28 18:33:34 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-28 18:33:34 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-28 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW82194%27 HTTP/1.1" 200 None
2026-03-28 18:33:34 [auto1.de] INFO: Scrape type for PW82194: 0
2026-03-28 18:33:34 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-28 18:33:34 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-28 18:33:34 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-28 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA88514%27 HTTP/1.1" 200 None
2026-03-28 18:33:34 [auto1.de] INFO: Scrape type for XA88514: 0
2026-03-28 18:33:34 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-28 18:33:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK41748%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for GK41748: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19206%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for UB19206: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE54720%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for VE54720: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA52648%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for YA52648: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP35448%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for FP35448: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU23189%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for JU23189: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC18756%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for PC18756: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT48598%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for YT48598: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC76019%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for FC76019: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK93777%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for CK93777: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX61544%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for TX61544: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET07412%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for ET07412: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL84965%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for BL84965: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC17243%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for XC17243: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89022%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for ZT89022: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA73958%27 HTTP/1.1" 200 None
2026-03-28 18:33:35 [auto1.de] INFO: Scrape type for MA73958: 0
2026-03-28 18:33:35 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-28 18:33:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:36 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:36 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-28 18:33:36 [auto1.de] INFO: Scrape type for ZH21180: 2
2026-03-28 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02d00dec-8d76-52fe-aada-729dd9d39940 with identifier: ZH21180
2026-03-28 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02d00dec-8d76-52fe-aada-729dd9d39940 with scrape type 2
2026-03-28 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02d00dec-8d76-52fe-aada-729dd9d39940 with scrape type 2
2026-03-28 18:33:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02d00dec-8d76-52fe-aada-729dd9d39940, identifier: ZH21180
2026-03-28 18:33:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02d00dec-8d76-52fe-aada-729dd9d39940 with identifier: ZH21180
2026-03-28 18:33:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02d00dec-8d76-52fe-aada-729dd9d39940 with identifier: ZH21180
2026-03-28 18:33:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02d00dec-8d76-52fe-aada-729dd9d39940 with identifier: ZH21180 to the API
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:14Z',
 'fuel_type': 'diesel',
 'id': '02d00dec-8d76-52fe-aada-729dd9d39940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH21180',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 110498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-11',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Laurin & Klement',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement',
 'year': 2019}
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH21180%27 HTTP/1.1" 200 None
2026-03-28 18:33:36 [auto1.de] INFO: Saving data for ZH21180: {'auction_closing_time': 1774883414.0, 'created_time': 1774636349.307379, 'last_price_update_time': 1774722816.760775}
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH21180') HTTP/1.1" 204 0
2026-03-28 18:33:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:36 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-28 18:33:36 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-28 18:33:36 [auto1.de] INFO: Scrape type for JC65588: 1
2026-03-28 18:33:36 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-28 18:33:36 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39505%27 HTTP/1.1" 200 None
2026-03-28 18:33:36 [auto1.de] INFO: Scrape type for UW39505: 0
2026-03-28 18:33:36 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD20057%27 HTTP/1.1" 200 None
2026-03-28 18:33:36 [auto1.de] INFO: Scrape type for MD20057: 0
2026-03-28 18:33:36 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-28 18:33:36 [auto1.de] INFO: Scrape type for FL94183: 2
2026-03-28 18:33:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with identifier: FL94183
2026-03-28 18:33:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with scrape type 2
2026-03-28 18:33:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with scrape type 2
2026-03-28 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb, identifier: FL94183
2026-03-28 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with identifier: FL94183
2026-03-28 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with identifier: FL94183
2026-03-28 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a2935a5-8727-5a4e-a5bb-50ad22c79ceb with identifier: FL94183 to the API
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:49:32Z',
 'fuel_type': 'petrol',
 'id': '7a2935a5-8727-5a4e-a5bb-50ad22c79ceb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL94183',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 123205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2015}
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL94183%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Saving data for FL94183: {'auction_closing_time': 1774885772.0, 'created_time': 1774522059.543818, 'last_price_update_time': 1774722817.339204}
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL94183') HTTP/1.1" 204 0
2026-03-28 18:33:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC25925%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for EC25925: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT21646%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for LT21646: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE69910%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for DE69910: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU24195%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for EU24195: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT60185%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for NT60185: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27020%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for NT27020: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT01969%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for RT01969: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS65923%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for MS65923: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV29308%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for ZV29308: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX60280%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for SX60280: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU96815%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for TU96815: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW42175%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for LW42175: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE09652%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for PE09652: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42625%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for DE42625: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD67762%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for PD67762: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC01446%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for RC01446: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR57506%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for HR57506: 0
2026-03-28 18:33:37 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-28 18:33:37 [auto1.de] INFO: Scrape type for HF86895: 2
2026-03-28 18:33:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46f51e7d-2959-5dd9-af67-c724dffabdbd with identifier: HF86895
2026-03-28 18:33:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46f51e7d-2959-5dd9-af67-c724dffabdbd with scrape type 2
2026-03-28 18:33:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46f51e7d-2959-5dd9-af67-c724dffabdbd with scrape type 2
2026-03-28 18:33:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 46f51e7d-2959-5dd9-af67-c724dffabdbd, identifier: HF86895
2026-03-28 18:33:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 46f51e7d-2959-5dd9-af67-c724dffabdbd with identifier: HF86895
2026-03-28 18:33:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 46f51e7d-2959-5dd9-af67-c724dffabdbd with identifier: HF86895
2026-03-28 18:33:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 46f51e7d-2959-5dd9-af67-c724dffabdbd with identifier: HF86895 to the API
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:59Z',
 'fuel_type': 'petrol',
 'id': '46f51e7d-2959-5dd9-af67-c724dffabdbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF86895',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 90549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-02',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF86895%27 HTTP/1.1" 200 None
2026-03-28 18:33:38 [auto1.de] INFO: Saving data for HF86895: {'auction_closing_time': 1774884359.0, 'created_time': 1773946473.476026, 'last_price_update_time': 1774722818.072036}
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF86895') HTTP/1.1" 204 0
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-28 18:33:38 [auto1.de] INFO: Scrape type for SA50642: 2
2026-03-28 18:33:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with identifier: SA50642
2026-03-28 18:33:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with scrape type 2
2026-03-28 18:33:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with scrape type 2
2026-03-28 18:33:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c, identifier: SA50642
2026-03-28 18:33:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with identifier: SA50642
2026-03-28 18:33:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with identifier: SA50642
2026-03-28 18:33:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ca63a10-fe6b-51a4-aa41-d67268b76f9c with identifier: SA50642 to the API
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:33:58Z',
 'fuel_type': 'diesel',
 'id': '2ca63a10-fe6b-51a4-aa41-d67268b76f9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA50642',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 491320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-10',
 'seller_name': None,
 'title': 'BMW 5er 530d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA50642%27 HTTP/1.1" 200 None
2026-03-28 18:33:38 [auto1.de] INFO: Saving data for SA50642: {'auction_closing_time': 1774884838.0, 'created_time': 1774521531.024252, 'last_price_update_time': 1774722818.588391}
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA50642') HTTP/1.1" 204 0
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT29598%27 HTTP/1.1" 200 None
2026-03-28 18:33:38 [auto1.de] INFO: Scrape type for TT29598: 0
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM47642%27 HTTP/1.1" 200 None
2026-03-28 18:33:38 [auto1.de] INFO: Scrape type for GM47642: 0
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM87462%27 HTTP/1.1" 200 None
2026-03-28 18:33:38 [auto1.de] INFO: Scrape type for XM87462: 0
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR47170%27 HTTP/1.1" 200 None
2026-03-28 18:33:38 [auto1.de] INFO: Scrape type for GR47170: 0
2026-03-28 18:33:38 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-28 18:33:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JC65588/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:40 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA78994%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for XA78994: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP25717%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for BP25717: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50378%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for WY50378: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV16310%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for EV16310: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK35752%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for CK35752: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ41164%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for XJ41164: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU26768%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for ZU26768: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD29565%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for DD29565: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE11389%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for WE11389: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW86631%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for MW86631: 0
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-28 18:33:40 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-28 18:33:40 [auto1.de] INFO: Scrape type for YT53234: 2
2026-03-28 18:33:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c30aac1b-c7cb-51bb-b55e-896d77089f47 with identifier: YT53234
2026-03-28 18:33:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c30aac1b-c7cb-51bb-b55e-896d77089f47 with scrape type 2
2026-03-28 18:33:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c30aac1b-c7cb-51bb-b55e-896d77089f47 with scrape type 2
2026-03-28 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c30aac1b-c7cb-51bb-b55e-896d77089f47, identifier: YT53234
2026-03-28 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c30aac1b-c7cb-51bb-b55e-896d77089f47 with identifier: YT53234
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-28 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c30aac1b-c7cb-51bb-b55e-896d77089f47 with identifier: YT53234
2026-03-28 18:33:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c30aac1b-c7cb-51bb-b55e-896d77089f47 with identifier: YT53234 to the API
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:21Z',
 'fuel_type': 'gas',
 'id': 'c30aac1b-c7cb-51bb-b55e-896d77089f47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT53234',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 155819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI EcoFuel Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT53234%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Saving data for YT53234: {'auction_closing_time': 1774883001.0, 'created_time': 1774522314.005285, 'last_price_update_time': 1774722821.64105}
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT53234') HTTP/1.1" 204 0
2026-03-28 18:33:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK93112%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Scrape type for PK93112: 0
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97511%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Scrape type for PF97511: 0
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02654%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Scrape type for WS02654: 0
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS10261%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Scrape type for VS10261: 0
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD70281%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Scrape type for DD70281: 0
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE91450%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Scrape type for PE91450: 0
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG44703%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Scrape type for NG44703: 0
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-28 18:33:41 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-28 18:33:41 [auto1.de] INFO: Scrape type for TH77412: 2
2026-03-28 18:33:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with identifier: TH77412
2026-03-28 18:33:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with scrape type 2
2026-03-28 18:33:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with scrape type 2
2026-03-28 18:33:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c, identifier: TH77412
2026-03-28 18:33:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with identifier: TH77412
2026-03-28 18:33:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with identifier: TH77412
2026-03-28 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c with identifier: TH77412 to the API
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:53Z',
 'fuel_type': 'petrol',
 'id': '8d3435f2-bee7-5874-bdfe-7e1f4c6ba79c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH77412',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 159256,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-20',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH77412%27 HTTP/1.1" 200 None
2026-03-28 18:33:42 [auto1.de] INFO: Saving data for TH77412: {'auction_closing_time': 1774885913.0, 'created_time': 1774522231.311459, 'last_price_update_time': 1774722822.298982}
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH77412') HTTP/1.1" 204 0
2026-03-28 18:33:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JC65588> (referer: https://www.auto1.com/v1/car-details-view/JC65588/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77147a72-9fc5-5286-8c53-b8c61fb023cb with identifier: JC65588
2026-03-28 18:33:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77147a72-9fc5-5286-8c53-b8c61fb023cb with scrape type 1
2026-03-28 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 77147a72-9fc5-5286-8c53-b8c61fb023cb
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fd5%252F01d586dc7161f7545c69a0628448d656%252Fpa%252FJC65588_a98cbdf6c37517e5c8ee7ab68ee01bca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_a98cbdf6c37517e5c8ee7ab68ee01bca.jpg already downloaded
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fd5%252F01d586dc7161f7545c69a0628448d656%252Fpa%252FJC65588_4ce9befc985e8a75c5995a9564f1309e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_4ce9befc985e8a75c5995a9564f1309e.jpg already downloaded
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fd5%252F01d586dc7161f7545c69a0628448d656%252Fpa%252FJC65588_5d3bb2ea9d7d3ff9e5936abf4676242e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_5d3bb2ea9d7d3ff9e5936abf4676242e.jpg already downloaded
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fd5%252F01d586dc7161f7545c69a0628448d656%252Fpa%252FJC65588_925c1fc7648b58bdf8b7346e711752f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_925c1fc7648b58bdf8b7346e711752f9.jpg already downloaded
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fd5%252F01d586dc7161f7545c69a0628448d656%252Fpa%252FJC65588_7ceb4e36c89e15ac38918a9dcc73e06c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_7ceb4e36c89e15ac38918a9dcc73e06c.jpg already downloaded
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg01%252Fd5%252F01d586dc7161f7545c69a0628448d656%252Fpa%252FJC65588_965edbad224fb9ce4f34721ce54eda0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:33:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_965edbad224fb9ce4f34721ce54eda0c.jpg already downloaded
2026-03-28 18:33:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77147a72-9fc5-5286-8c53-b8c61fb023cb, identifier: JC65588
2026-03-28 18:33:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77147a72-9fc5-5286-8c53-b8c61fb023cb with identifier: JC65588
2026-03-28 18:33:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77147a72-9fc5-5286-8c53-b8c61fb023cb with identifier: JC65588
2026-03-28 18:33:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77147a72-9fc5-5286-8c53-b8c61fb023cb with identifier: JC65588 to the API
2026-03-28 18:33:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JC65588>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:10:40Z',
 'fuel_type': 'petrol',
 'id': '77147a72-9fc5-5286-8c53-b8c61fb023cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC65588',
 'listing': 'auction',
 'location': 'DE, Saarlouis',
 'make': 'Volkswagen',
 'model': 'New Beetle',
 'odometer': 200791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_a98cbdf6c37517e5c8ee7ab68ee01bca.jpg',
                'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_4ce9befc985e8a75c5995a9564f1309e.jpg',
                'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_5d3bb2ea9d7d3ff9e5936abf4676242e.jpg',
                'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_925c1fc7648b58bdf8b7346e711752f9.jpg',
                'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_7ceb4e36c89e15ac38918a9dcc73e06c.jpg',
                'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_965edbad224fb9ce4f34721ce54eda0c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77147a72-9fc5-5286-8c53-b8c61fb023cb/77147a72-9fc5-5286-8c53-b8c61fb023cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_a98cbdf6c37517e5c8ee7ab68ee01bca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77147a72-9fc5-5286-8c53-b8c61fb023cb/77147a72-9fc5-5286-8c53-b8c61fb023cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_4ce9befc985e8a75c5995a9564f1309e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77147a72-9fc5-5286-8c53-b8c61fb023cb/77147a72-9fc5-5286-8c53-b8c61fb023cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_5d3bb2ea9d7d3ff9e5936abf4676242e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77147a72-9fc5-5286-8c53-b8c61fb023cb/77147a72-9fc5-5286-8c53-b8c61fb023cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_925c1fc7648b58bdf8b7346e711752f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77147a72-9fc5-5286-8c53-b8c61fb023cb/77147a72-9fc5-5286-8c53-b8c61fb023cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_7ceb4e36c89e15ac38918a9dcc73e06c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77147a72-9fc5-5286-8c53-b8c61fb023cb/77147a72-9fc5-5286-8c53-b8c61fb023cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img01/d5/01d586dc7161f7545c69a0628448d656/pa/JC65588_965edbad224fb9ce4f34721ce54eda0c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-08-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen New Beetle 1.6',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC65588%27 HTTP/1.1" 200 None
2026-03-28 18:33:43 [auto1.de] INFO: Saving data for JC65588: {'created_time': 1774722823.141087, 'last_price_update_time': 1774722823.141099, 'auction_closing_time': 1774883440.0}
2026-03-28 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC65588') HTTP/1.1" 204 0
2026-03-28 18:33:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:45 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS75707%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for MS75707: 0
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for SZ55877: 2
2026-03-28 18:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb79280c-127c-50a8-9ea7-2a1402a3970c with identifier: SZ55877
2026-03-28 18:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb79280c-127c-50a8-9ea7-2a1402a3970c with scrape type 2
2026-03-28 18:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb79280c-127c-50a8-9ea7-2a1402a3970c with scrape type 2
2026-03-28 18:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb79280c-127c-50a8-9ea7-2a1402a3970c, identifier: SZ55877
2026-03-28 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb79280c-127c-50a8-9ea7-2a1402a3970c with identifier: SZ55877
2026-03-28 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb79280c-127c-50a8-9ea7-2a1402a3970c with identifier: SZ55877
2026-03-28 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb79280c-127c-50a8-9ea7-2a1402a3970c with identifier: SZ55877 to the API
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:23Z',
 'fuel_type': 'diesel',
 'id': 'eb79280c-127c-50a8-9ea7-2a1402a3970c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ55877',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 141495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-06',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2017}
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ55877%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Saving data for SZ55877: {'auction_closing_time': 1774883003.0, 'created_time': 1773946074.5603, 'last_price_update_time': 1774722825.42591}
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ55877') HTTP/1.1" 204 0
2026-03-28 18:33:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH79941%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for CH79941: 0
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ62402%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for ZZ62402: 0
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX70846%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for BX70846: 0
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM31367%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for WM31367: 0
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK43100%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for AK43100: 0
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD59172%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for SD59172: 0
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-28 18:33:45 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Scrape type for GJ71722: 2
2026-03-28 18:33:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with identifier: GJ71722
2026-03-28 18:33:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with scrape type 2
2026-03-28 18:33:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with scrape type 2
2026-03-28 18:33:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d, identifier: GJ71722
2026-03-28 18:33:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with identifier: GJ71722
2026-03-28 18:33:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with identifier: GJ71722
2026-03-28 18:33:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7ca7b95-735b-5c73-9ecc-cd503ceeb19d with identifier: GJ71722 to the API
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:13Z',
 'fuel_type': 'petrol',
 'id': 'a7ca7b95-735b-5c73-9ecc-cd503ceeb19d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ71722',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 21707,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-03',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2020}
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71722%27 HTTP/1.1" 200 None
2026-03-28 18:33:45 [auto1.de] INFO: Saving data for GJ71722: {'auction_closing_time': 1774886173.0, 'created_time': 1773428076.421312, 'last_price_update_time': 1774722825.964708}
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ71722') HTTP/1.1" 204 0
2026-03-28 18:33:46 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW31978%27 HTTP/1.1" 200 None
2026-03-28 18:33:46 [auto1.de] INFO: Scrape type for MW31978: 0
2026-03-28 18:33:46 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-28 18:33:46 [auto1.de] INFO: Scrape type for SR59541: 2
2026-03-28 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10854e40-e34c-5a76-ad28-17e40926b7de with identifier: SR59541
2026-03-28 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10854e40-e34c-5a76-ad28-17e40926b7de with scrape type 2
2026-03-28 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10854e40-e34c-5a76-ad28-17e40926b7de with scrape type 2
2026-03-28 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10854e40-e34c-5a76-ad28-17e40926b7de, identifier: SR59541
2026-03-28 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10854e40-e34c-5a76-ad28-17e40926b7de with identifier: SR59541
2026-03-28 18:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10854e40-e34c-5a76-ad28-17e40926b7de with identifier: SR59541
2026-03-28 18:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10854e40-e34c-5a76-ad28-17e40926b7de with identifier: SR59541 to the API
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:12:12Z',
 'fuel_type': 'diesel',
 'id': '10854e40-e34c-5a76-ad28-17e40926b7de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR59541',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 254378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-08',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 300 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2011}
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR59541%27 HTTP/1.1" 200 None
2026-03-28 18:33:46 [auto1.de] INFO: Saving data for SR59541: {'auction_closing_time': 1774883532.0, 'created_time': 1774089323.457641, 'last_price_update_time': 1774722826.540629}
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR59541') HTTP/1.1" 204 0
2026-03-28 18:33:46 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-28 18:33:46 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY67891%27 HTTP/1.1" 200 None
2026-03-28 18:33:46 [auto1.de] INFO: Scrape type for NY67891: 0
2026-03-28 18:33:46 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV44481%27 HTTP/1.1" 200 None
2026-03-28 18:33:46 [auto1.de] INFO: Scrape type for HV44481: 0
2026-03-28 18:33:46 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR35436%27 HTTP/1.1" 200 None
2026-03-28 18:33:46 [auto1.de] INFO: Scrape type for CR35436: 0
2026-03-28 18:33:46 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-28 18:33:46 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-28 18:33:46 [auto1.de] INFO: Scrape type for SU06279: 2
2026-03-28 18:33:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23325444-9cbf-577a-beed-221df573258f with identifier: SU06279
2026-03-28 18:33:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23325444-9cbf-577a-beed-221df573258f with scrape type 2
2026-03-28 18:33:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23325444-9cbf-577a-beed-221df573258f with scrape type 2
2026-03-28 18:33:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23325444-9cbf-577a-beed-221df573258f, identifier: SU06279
2026-03-28 18:33:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23325444-9cbf-577a-beed-221df573258f with identifier: SU06279
2026-03-28 18:33:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23325444-9cbf-577a-beed-221df573258f with identifier: SU06279
2026-03-28 18:33:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23325444-9cbf-577a-beed-221df573258f with identifier: SU06279 to the API
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:11:43Z',
 'fuel_type': 'diesel',
 'id': '23325444-9cbf-577a-beed-221df573258f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU06279',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 275945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-25',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Drive 125 4x4',
 'transmission': 'automatic',
 'trim': 'Drive 125 4x4',
 'year': 2020}
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU06279%27 HTTP/1.1" 200 None
2026-03-28 18:33:47 [auto1.de] INFO: Saving data for SU06279: {'auction_closing_time': 1774883503.0, 'created_time': 1774349893.903993, 'last_price_update_time': 1774722827.024304}
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU06279') HTTP/1.1" 204 0
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-28 18:33:47 [auto1.de] INFO: Scrape type for HW53715: 2
2026-03-28 18:33:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with identifier: HW53715
2026-03-28 18:33:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with scrape type 2
2026-03-28 18:33:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with scrape type 2
2026-03-28 18:33:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca, identifier: HW53715
2026-03-28 18:33:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with identifier: HW53715
2026-03-28 18:33:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with identifier: HW53715
2026-03-28 18:33:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94e08fe9-7b47-56ff-9dde-c55bb8dfaeca with identifier: HW53715 to the API
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:23:39Z',
 'fuel_type': 'petrol',
 'id': '94e08fe9-7b47-56ff-9dde-c55bb8dfaeca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW53715',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 131748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-18',
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Navi',
 'transmission': 'automatic',
 'trim': 'Navi',
 'year': 2007}
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW53715%27 HTTP/1.1" 200 None
2026-03-28 18:33:47 [auto1.de] INFO: Saving data for HW53715: {'auction_closing_time': 1774884219.0, 'created_time': 1773466224.248574, 'last_price_update_time': 1774722827.473715}
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW53715') HTTP/1.1" 204 0
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV89057%27 HTTP/1.1" 200 None
2026-03-28 18:33:47 [auto1.de] INFO: Scrape type for CV89057: 0
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR44152%27 HTTP/1.1" 200 None
2026-03-28 18:33:47 [auto1.de] INFO: Scrape type for HR44152: 0
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA30425%27 HTTP/1.1" 200 None
2026-03-28 18:33:47 [auto1.de] INFO: Scrape type for AA30425: 0
2026-03-28 18:33:47 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS01662%27 HTTP/1.1" 200 None
2026-03-28 18:33:47 [auto1.de] INFO: Scrape type for YS01662: 0
2026-03-28 18:33:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:48 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB14083%27 HTTP/1.1" 200 None
2026-03-28 18:33:48 [auto1.de] INFO: Scrape type for AB14083: 0
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL45560%27 HTTP/1.1" 200 None
2026-03-28 18:33:48 [auto1.de] INFO: Scrape type for DL45560: 0
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK17459%27 HTTP/1.1" 200 None
2026-03-28 18:33:48 [auto1.de] INFO: Scrape type for JK17459: 0
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC28656%27 HTTP/1.1" 200 None
2026-03-28 18:33:48 [auto1.de] INFO: Scrape type for GC28656: 0
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT10840%27 HTTP/1.1" 200 None
2026-03-28 18:33:48 [auto1.de] INFO: Scrape type for KT10840: 0
2026-03-28 18:33:48 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-28 18:33:48 [auto1.de] INFO: Scrape type for AK58988: 2
2026-03-28 18:33:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with identifier: AK58988
2026-03-28 18:33:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with scrape type 2
2026-03-28 18:33:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with scrape type 2
2026-03-28 18:33:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19f53cc6-b6a8-59b5-b676-b53a91f3c490, identifier: AK58988
2026-03-28 18:33:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with identifier: AK58988
2026-03-28 18:33:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with identifier: AK58988
2026-03-28 18:33:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19f53cc6-b6a8-59b5-b676-b53a91f3c490 with identifier: AK58988 to the API
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:42:21Z',
 'fuel_type': 'petrol',
 'id': '19f53cc6-b6a8-59b5-b676-b53a91f3c490',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK58988',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '911',
 'odometer': 140558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1993-02-03',
 'seller_name': None,
 'title': 'Porsche 911 964 Carrera 2 Cabrio',
 'transmission': 'manual',
 'trim': 'Carrera 2 Cabrio',
 'year': 1993}
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK58988%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Saving data for AK58988: {'auction_closing_time': 1774885341.0, 'created_time': 1773466892.742894, 'last_price_update_time': 1774722829.719084}
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK58988') HTTP/1.1" 204 0
2026-03-28 18:33:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV81502%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for BV81502: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE39343%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for TE39343: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR13595%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for HR13595: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN63350%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for ZN63350: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC75041%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for FC75041: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP85770%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for PP85770: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY07286%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for VY07286: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH71943%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for AH71943: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP81674%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for KP81674: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG63340%27 HTTP/1.1" 200 None
2026-03-28 18:33:49 [auto1.de] INFO: Scrape type for MG63340: 0
2026-03-28 18:33:49 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-28 18:33:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN06918%27 HTTP/1.1" 200 None
2026-03-28 18:33:50 [auto1.de] INFO: Scrape type for JN06918: 0
2026-03-28 18:33:50 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-28 18:33:50 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-28 18:33:50 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-28 18:33:50 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-28 18:33:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:50 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 5995 | hits on page: 40
2026-03-28 18:33:50 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-28 18:33:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE11202%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for UE11202: 0
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89530%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for VS89530: 0
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU16718%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for HU16718: 0
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ19691%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for HZ19691: 0
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for ZJ39351: 2
2026-03-28 18:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2243856-a513-55c6-b9aa-61de1462e166 with identifier: ZJ39351
2026-03-28 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2243856-a513-55c6-b9aa-61de1462e166 with scrape type 2
2026-03-28 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2243856-a513-55c6-b9aa-61de1462e166 with scrape type 2
2026-03-28 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2243856-a513-55c6-b9aa-61de1462e166, identifier: ZJ39351
2026-03-28 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2243856-a513-55c6-b9aa-61de1462e166 with identifier: ZJ39351
2026-03-28 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2243856-a513-55c6-b9aa-61de1462e166 with identifier: ZJ39351
2026-03-28 18:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2243856-a513-55c6-b9aa-61de1462e166 with identifier: ZJ39351 to the API
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:47:26Z',
 'fuel_type': 'diesel',
 'id': 'd2243856-a513-55c6-b9aa-61de1462e166',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ39351',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 310660,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ39351%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Saving data for ZJ39351: {'auction_closing_time': 1774885646.0, 'created_time': 1774521327.318543, 'last_price_update_time': 1774722831.498019}
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ39351') HTTP/1.1" 204 0
2026-03-28 18:33:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ71041%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for FJ71041: 0
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR18814%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for RR18814: 0
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY11895%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for WY11895: 0
2026-03-28 18:33:51 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-28 18:33:51 [auto1.de] INFO: Scrape type for LC91411: 2
2026-03-28 18:33:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3380c483-8ae8-536d-9b30-b95ce534293b with identifier: LC91411
2026-03-28 18:33:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3380c483-8ae8-536d-9b30-b95ce534293b with scrape type 2
2026-03-28 18:33:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3380c483-8ae8-536d-9b30-b95ce534293b with scrape type 2
2026-03-28 18:33:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3380c483-8ae8-536d-9b30-b95ce534293b, identifier: LC91411
2026-03-28 18:33:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3380c483-8ae8-536d-9b30-b95ce534293b with identifier: LC91411
2026-03-28 18:33:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3380c483-8ae8-536d-9b30-b95ce534293b with identifier: LC91411
2026-03-28 18:33:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3380c483-8ae8-536d-9b30-b95ce534293b with identifier: LC91411 to the API
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:43:08Z',
 'fuel_type': 'diesel',
 'id': '3380c483-8ae8-536d-9b30-b95ce534293b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC91411',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 20354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Fiat Talento 2.0 TwinTurbo Diesel Ecojet L2H1 1,2t Family',
 'transmission': 'manual',
 'trim': 'L2H1 1,2t Family',
 'year': 2019}
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC91411%27 HTTP/1.1" 200 None
2026-03-28 18:33:52 [auto1.de] INFO: Saving data for LC91411: {'auction_closing_time': 1774885388.0, 'created_time': 1774118640.250845, 'last_price_update_time': 1774722832.09392}
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC91411') HTTP/1.1" 204 0
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA53807%27 HTTP/1.1" 200 None
2026-03-28 18:33:52 [auto1.de] INFO: Scrape type for NA53807: 0
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW78098%27 HTTP/1.1" 200 None
2026-03-28 18:33:52 [auto1.de] INFO: Scrape type for UW78098: 0
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-28 18:33:52 [auto1.de] INFO: Scrape type for XU28434: 2
2026-03-28 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with identifier: XU28434
2026-03-28 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with scrape type 2
2026-03-28 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with scrape type 2
2026-03-28 18:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a, identifier: XU28434
2026-03-28 18:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with identifier: XU28434
2026-03-28 18:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with identifier: XU28434
2026-03-28 18:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a with identifier: XU28434 to the API
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:41:33Z',
 'fuel_type': 'diesel',
 'id': '4a8d60e0-57be-54df-8b9b-9f5e5acd7a2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU28434',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 65009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-22',
 'seller_name': None,
 'title': 'Volvo V90 2.0 D4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2020}
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU28434%27 HTTP/1.1" 200 None
2026-03-28 18:33:52 [auto1.de] INFO: Saving data for XU28434: {'auction_closing_time': 1774885293.0, 'created_time': 1774521448.035566, 'last_price_update_time': 1774722832.566104}
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU28434') HTTP/1.1" 204 0
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE84214%27 HTTP/1.1" 200 None
2026-03-28 18:33:52 [auto1.de] INFO: Scrape type for AE84214: 0
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD94440%27 HTTP/1.1" 200 None
2026-03-28 18:33:52 [auto1.de] INFO: Scrape type for KD94440: 0
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-28 18:33:52 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-28 18:33:52 [auto1.de] INFO: Scrape type for KL26301: 2
2026-03-28 18:33:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with identifier: KL26301
2026-03-28 18:33:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with scrape type 2
2026-03-28 18:33:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with scrape type 2
2026-03-28 18:33:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1, identifier: KL26301
2026-03-28 18:33:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with identifier: KL26301
2026-03-28 18:33:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with identifier: KL26301
2026-03-28 18:33:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01a26636-1b04-5c1a-b3ee-70f1fc6106a1 with identifier: KL26301 to the API
2026-03-28 18:33:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-30T15:03:09Z',
 'fuel_type': 'diesel',
 'id': '01a26636-1b04-5c1a-b3ee-70f1fc6106a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL26301',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 96043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-15',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL26301%27 HTTP/1.1" 200 None
2026-03-28 18:33:53 [auto1.de] INFO: Saving data for KL26301: {'auction_closing_time': 1774882989.0, 'created_time': 1773466253.682453, 'last_price_update_time': 1774722833.15742}
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL26301') HTTP/1.1" 204 0
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72377%27 HTTP/1.1" 200 None
2026-03-28 18:33:53 [auto1.de] INFO: Scrape type for MR72377: 0
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV55682%27 HTTP/1.1" 200 None
2026-03-28 18:33:53 [auto1.de] INFO: Scrape type for CV55682: 0
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF92976%27 HTTP/1.1" 200 None
2026-03-28 18:33:53 [auto1.de] INFO: Scrape type for FF92976: 0
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV74864%27 HTTP/1.1" 200 None
2026-03-28 18:33:53 [auto1.de] INFO: Scrape type for BV74864: 0
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: BG43270
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ91984%27 HTTP/1.1" 200 None
2026-03-28 18:33:53 [auto1.de] INFO: Scrape type for RZ91984: 0
2026-03-28 18:33:53 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-28 18:33:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:54 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 5996 | hits on page: 40
2026-03-28 18:33:54 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-28 18:33:54 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-28 18:33:54 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS77004%27 HTTP/1.1" 200 None
2026-03-28 18:33:54 [auto1.de] INFO: Scrape type for RS77004: 0
2026-03-28 18:33:54 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-28 18:33:54 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-28 18:33:54 [auto1.de] INFO: Scrape type for JU32018: 2
2026-03-28 18:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed47db1-f512-5c50-9234-d86cf36b1d04 with identifier: JU32018
2026-03-28 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ed47db1-f512-5c50-9234-d86cf36b1d04 with scrape type 2
2026-03-28 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ed47db1-f512-5c50-9234-d86cf36b1d04 with scrape type 2
2026-03-28 18:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ed47db1-f512-5c50-9234-d86cf36b1d04, identifier: JU32018
2026-03-28 18:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ed47db1-f512-5c50-9234-d86cf36b1d04 with identifier: JU32018
2026-03-28 18:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ed47db1-f512-5c50-9234-d86cf36b1d04 with identifier: JU32018
2026-03-28 18:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ed47db1-f512-5c50-9234-d86cf36b1d04 with identifier: JU32018 to the API
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:05Z',
 'fuel_type': 'petrol',
 'id': '6ed47db1-f512-5c50-9234-d86cf36b1d04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU32018',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 83426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-08',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU32018%27 HTTP/1.1" 200 None
2026-03-28 18:33:54 [auto1.de] INFO: Saving data for JU32018: {'auction_closing_time': 1774885265.0, 'created_time': 1773468069.220246, 'last_price_update_time': 1774722834.650323}
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU32018') HTTP/1.1" 204 0
2026-03-28 18:33:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:54 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ91980%27 HTTP/1.1" 200 None
2026-03-28 18:33:54 [auto1.de] INFO: Scrape type for FJ91980: 0
2026-03-28 18:33:54 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-28 18:33:54 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-28 18:33:54 [auto1.de] INFO: Scrape type for TV33488: 2
2026-03-28 18:33:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55d8f96-f863-590e-b3ff-f7c76999b31e with identifier: TV33488
2026-03-28 18:33:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c55d8f96-f863-590e-b3ff-f7c76999b31e with scrape type 2
2026-03-28 18:33:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c55d8f96-f863-590e-b3ff-f7c76999b31e with scrape type 2
2026-03-28 18:33:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c55d8f96-f863-590e-b3ff-f7c76999b31e, identifier: TV33488
2026-03-28 18:33:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c55d8f96-f863-590e-b3ff-f7c76999b31e with identifier: TV33488
2026-03-28 18:33:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c55d8f96-f863-590e-b3ff-f7c76999b31e with identifier: TV33488
2026-03-28 18:33:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c55d8f96-f863-590e-b3ff-f7c76999b31e with identifier: TV33488 to the API
2026-03-28 18:33:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:17:51Z',
 'fuel_type': 'petrol',
 'id': 'c55d8f96-f863-590e-b3ff-f7c76999b31e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV33488',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 141355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-22',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Dynamique',
 'transmission': 'automatic',
 'trim': 'Dynamique',
 'year': 2006}
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV33488%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Saving data for TV33488: {'auction_closing_time': 1774883871.0, 'created_time': 1773830599.773748, 'last_price_update_time': 1774722835.181452}
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV33488') HTTP/1.1" 204 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36326%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for GS36326: 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN30919%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for BN30919: 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF38507%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for DF38507: 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD55088%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for FD55088: 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN50743%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for BN50743: 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD02189%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for ZD02189: 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX76692%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for XX76692: 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for SJ47682: 2
2026-03-28 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cdcedef-5cb5-5033-b85e-1f59ee763109 with identifier: SJ47682
2026-03-28 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cdcedef-5cb5-5033-b85e-1f59ee763109 with scrape type 2
2026-03-28 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cdcedef-5cb5-5033-b85e-1f59ee763109 with scrape type 2
2026-03-28 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cdcedef-5cb5-5033-b85e-1f59ee763109, identifier: SJ47682
2026-03-28 18:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cdcedef-5cb5-5033-b85e-1f59ee763109 with identifier: SJ47682
2026-03-28 18:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cdcedef-5cb5-5033-b85e-1f59ee763109 with identifier: SJ47682
2026-03-28 18:33:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cdcedef-5cb5-5033-b85e-1f59ee763109 with identifier: SJ47682 to the API
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'petrol',
 'id': '8cdcedef-5cb5-5033-b85e-1f59ee763109',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ47682',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 185657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-26',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ47682%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Saving data for SJ47682: {'auction_closing_time': 1774883700.0, 'created_time': 1774349522.08966, 'last_price_update_time': 1774722835.752724}
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ47682') HTTP/1.1" 204 0
2026-03-28 18:33:55 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-28 18:33:55 [auto1.de] INFO: Scrape type for JT24059: 2
2026-03-28 18:33:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5072d91-16ee-5e15-8133-27911ccc2976 with identifier: JT24059
2026-03-28 18:33:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5072d91-16ee-5e15-8133-27911ccc2976 with scrape type 2
2026-03-28 18:33:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5072d91-16ee-5e15-8133-27911ccc2976 with scrape type 2
2026-03-28 18:33:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5072d91-16ee-5e15-8133-27911ccc2976, identifier: JT24059
2026-03-28 18:33:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5072d91-16ee-5e15-8133-27911ccc2976 with identifier: JT24059
2026-03-28 18:33:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5072d91-16ee-5e15-8133-27911ccc2976 with identifier: JT24059
2026-03-28 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5072d91-16ee-5e15-8133-27911ccc2976 with identifier: JT24059 to the API
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:24:06Z',
 'fuel_type': 'diesel',
 'id': 'a5072d91-16ee-5e15-8133-27911ccc2976',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT24059',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 137543,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-27',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT24059%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Saving data for JT24059: {'auction_closing_time': 1774884246.0, 'created_time': 1774521162.417672, 'last_price_update_time': 1774722836.275464}
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT24059') HTTP/1.1" 204 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW96119%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for CW96119: 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG28709%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for CG28709: 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU29418%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for AU29418: 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for VH78915: 2
2026-03-28 18:33:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5658db65-2ce8-5768-bd29-6f92465e336d with identifier: VH78915
2026-03-28 18:33:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5658db65-2ce8-5768-bd29-6f92465e336d with scrape type 2
2026-03-28 18:33:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5658db65-2ce8-5768-bd29-6f92465e336d with scrape type 2
2026-03-28 18:33:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5658db65-2ce8-5768-bd29-6f92465e336d, identifier: VH78915
2026-03-28 18:33:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5658db65-2ce8-5768-bd29-6f92465e336d with identifier: VH78915
2026-03-28 18:33:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5658db65-2ce8-5768-bd29-6f92465e336d with identifier: VH78915
2026-03-28 18:33:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5658db65-2ce8-5768-bd29-6f92465e336d with identifier: VH78915 to the API
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:56Z',
 'fuel_type': 'diesel',
 'id': '5658db65-2ce8-5768-bd29-6f92465e336d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH78915',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 327011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-28',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Team 4Motion',
 'transmission': 'automatic',
 'trim': 'Team 4Motion',
 'year': 2010}
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78915%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Saving data for VH78915: {'auction_closing_time': 1774885376.0, 'created_time': 1774522410.208154, 'last_price_update_time': 1774722836.788975}
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH78915') HTTP/1.1" 204 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP08748%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for RP08748: 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ41202%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for JJ41202: 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC13471%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for WC13471: 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK51417%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for TK51417: 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL51386%27 HTTP/1.1" 200 None
2026-03-28 18:33:56 [auto1.de] INFO: Scrape type for AL51386: 0
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-28 18:33:56 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-28 18:33:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:33:57 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 5996 | hits on page: 40
2026-03-28 18:33:57 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-28 18:33:57 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-28 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG78527%27 HTTP/1.1" 200 None
2026-03-28 18:33:57 [auto1.de] INFO: Scrape type for WG78527: 0
2026-03-28 18:33:57 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-28 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR96483%27 HTTP/1.1" 200 None
2026-03-28 18:33:57 [auto1.de] INFO: Scrape type for BR96483: 0
2026-03-28 18:33:57 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-28 18:33:57 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-28 18:33:57 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-28 18:33:57 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-28 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-28 18:33:57 [auto1.de] INFO: Scrape type for JD98482: 2
2026-03-28 18:33:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27728961-ee35-5b47-b9a9-e274e913174d with identifier: JD98482
2026-03-28 18:33:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27728961-ee35-5b47-b9a9-e274e913174d with scrape type 2
2026-03-28 18:33:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27728961-ee35-5b47-b9a9-e274e913174d with scrape type 2
2026-03-28 18:33:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27728961-ee35-5b47-b9a9-e274e913174d, identifier: JD98482
2026-03-28 18:33:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27728961-ee35-5b47-b9a9-e274e913174d with identifier: JD98482
2026-03-28 18:33:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27728961-ee35-5b47-b9a9-e274e913174d with identifier: JD98482
2026-03-28 18:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27728961-ee35-5b47-b9a9-e274e913174d with identifier: JD98482 to the API
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:19:10Z',
 'fuel_type': 'diesel',
 'id': '27728961-ee35-5b47-b9a9-e274e913174d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD98482',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 171552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-14',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD98482%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Saving data for JD98482: {'auction_closing_time': 1774883950.0, 'created_time': 1774636308.556865, 'last_price_update_time': 1774722838.264961}
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD98482') HTTP/1.1" 204 0
2026-03-28 18:33:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW77024%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for NW77024: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL88784%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for LL88784: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE44500%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for VE44500: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR72053%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for NR72053: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK68029%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for HK68029: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ30709%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for GZ30709: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC82982%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for NC82982: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ19342%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for VZ19342: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV97095%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for PV97095: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP61796%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for WP61796: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB73740%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for WB73740: 0
2026-03-28 18:33:58 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-28 18:33:58 [auto1.de] INFO: Scrape type for KY92219: 2
2026-03-28 18:33:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9863d15d-9531-574e-bc4a-c12b19e55ef3 with identifier: KY92219
2026-03-28 18:33:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9863d15d-9531-574e-bc4a-c12b19e55ef3 with scrape type 2
2026-03-28 18:33:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9863d15d-9531-574e-bc4a-c12b19e55ef3 with scrape type 2
2026-03-28 18:33:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9863d15d-9531-574e-bc4a-c12b19e55ef3, identifier: KY92219
2026-03-28 18:33:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9863d15d-9531-574e-bc4a-c12b19e55ef3 with identifier: KY92219
2026-03-28 18:33:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9863d15d-9531-574e-bc4a-c12b19e55ef3 with identifier: KY92219
2026-03-28 18:33:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9863d15d-9531-574e-bc4a-c12b19e55ef3 with identifier: KY92219 to the API
2026-03-28 18:33:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:33:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:22:19Z',
 'fuel_type': 'petrol',
 'id': '9863d15d-9531-574e-bc4a-c12b19e55ef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY92219',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 35554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TSI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2019}
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY92219%27 HTTP/1.1" 200 None
2026-03-28 18:33:59 [auto1.de] INFO: Saving data for KY92219: {'auction_closing_time': 1774884139.0, 'created_time': 1774521616.321481, 'last_price_update_time': 1774722839.704533}
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY92219') HTTP/1.1" 204 0
2026-03-28 18:33:59 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH57189%27 HTTP/1.1" 200 None
2026-03-28 18:33:59 [auto1.de] INFO: Scrape type for GH57189: 0
2026-03-28 18:33:59 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:33:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-28 18:33:59 [auto1.de] INFO: Scrape type for EN93789: 2
2026-03-28 18:33:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3905ed05-11c2-527f-92eb-5ce8b7dce161 with identifier: EN93789
2026-03-28 18:33:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3905ed05-11c2-527f-92eb-5ce8b7dce161 with scrape type 2
2026-03-28 18:33:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3905ed05-11c2-527f-92eb-5ce8b7dce161 with scrape type 2
2026-03-28 18:33:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3905ed05-11c2-527f-92eb-5ce8b7dce161, identifier: EN93789
2026-03-28 18:33:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3905ed05-11c2-527f-92eb-5ce8b7dce161 with identifier: EN93789
2026-03-28 18:33:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3905ed05-11c2-527f-92eb-5ce8b7dce161 with identifier: EN93789
2026-03-28 18:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3905ed05-11c2-527f-92eb-5ce8b7dce161 with identifier: EN93789 to the API
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:06:18Z',
 'fuel_type': 'petrol',
 'id': '3905ed05-11c2-527f-92eb-5ce8b7dce161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN93789',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 80303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2020}
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN93789%27 HTTP/1.1" 200 None
2026-03-28 18:34:00 [auto1.de] INFO: Saving data for EN93789: {'auction_closing_time': 1774883178.0, 'created_time': 1774521412.805229, 'last_price_update_time': 1774722840.269911}
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN93789') HTTP/1.1" 204 0
2026-03-28 18:34:00 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-28 18:34:00 [auto1.de] INFO: Scrape type for VC01658: 2
2026-03-28 18:34:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a733c34-9214-5934-a9b0-60e7f16ea3be with identifier: VC01658
2026-03-28 18:34:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a733c34-9214-5934-a9b0-60e7f16ea3be with scrape type 2
2026-03-28 18:34:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a733c34-9214-5934-a9b0-60e7f16ea3be with scrape type 2
2026-03-28 18:34:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a733c34-9214-5934-a9b0-60e7f16ea3be, identifier: VC01658
2026-03-28 18:34:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a733c34-9214-5934-a9b0-60e7f16ea3be with identifier: VC01658
2026-03-28 18:34:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a733c34-9214-5934-a9b0-60e7f16ea3be with identifier: VC01658
2026-03-28 18:34:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a733c34-9214-5934-a9b0-60e7f16ea3be with identifier: VC01658 to the API
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-30T15:16:42Z',
 'fuel_type': 'petrol',
 'id': '1a733c34-9214-5934-a9b0-60e7f16ea3be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC01658',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5',
 'odometer': 85108,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-10',
 'seller_name': None,
 'title': 'Audi S5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC01658%27 HTTP/1.1" 200 None
2026-03-28 18:34:00 [auto1.de] INFO: Saving data for VC01658: {'auction_closing_time': 1774883802.0, 'created_time': 1773137756.452149, 'last_price_update_time': 1774722840.716021}
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC01658') HTTP/1.1" 204 0
2026-03-28 18:34:00 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK20534%27 HTTP/1.1" 200 None
2026-03-28 18:34:00 [auto1.de] INFO: Scrape type for HK20534: 0
2026-03-28 18:34:00 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU27688%27 HTTP/1.1" 200 None
2026-03-28 18:34:00 [auto1.de] INFO: Scrape type for AU27688: 0
2026-03-28 18:34:00 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-28 18:34:00 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-28 18:34:00 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-28 18:34:00 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-28 18:34:00 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-28 18:34:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:06 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 5996 | hits on page: 40
2026-03-28 18:34:06 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-28 18:34:06 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-28 18:34:06 [auto1.de] INFO: Scrape type for BB78660: 2
2026-03-28 18:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e40d57ec-fbca-580d-9c31-ad1640750801 with identifier: BB78660
2026-03-28 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e40d57ec-fbca-580d-9c31-ad1640750801 with scrape type 2
2026-03-28 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e40d57ec-fbca-580d-9c31-ad1640750801 with scrape type 2
2026-03-28 18:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e40d57ec-fbca-580d-9c31-ad1640750801, identifier: BB78660
2026-03-28 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e40d57ec-fbca-580d-9c31-ad1640750801 with identifier: BB78660
2026-03-28 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e40d57ec-fbca-580d-9c31-ad1640750801 with identifier: BB78660
2026-03-28 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e40d57ec-fbca-580d-9c31-ad1640750801 with identifier: BB78660 to the API
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:04:00Z',
 'fuel_type': 'diesel',
 'id': 'e40d57ec-fbca-580d-9c31-ad1640750801',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB78660',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 212114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-28',
 'seller_name': None,
 'title': 'BMW 3er 318d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB78660%27 HTTP/1.1" 200 None
2026-03-28 18:34:06 [auto1.de] INFO: Saving data for BB78660: {'auction_closing_time': 1774883040.0, 'created_time': 1774521913.686059, 'last_price_update_time': 1774722846.564442}
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB78660') HTTP/1.1" 204 0
2026-03-28 18:34:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:06 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-28 18:34:06 [auto1.de] INFO: Scrape type for TL72332: 2
2026-03-28 18:34:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 299484e0-51e9-531b-a440-71ba80474df8 with identifier: TL72332
2026-03-28 18:34:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 299484e0-51e9-531b-a440-71ba80474df8 with scrape type 2
2026-03-28 18:34:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 299484e0-51e9-531b-a440-71ba80474df8 with scrape type 2
2026-03-28 18:34:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 299484e0-51e9-531b-a440-71ba80474df8, identifier: TL72332
2026-03-28 18:34:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 299484e0-51e9-531b-a440-71ba80474df8 with identifier: TL72332
2026-03-28 18:34:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 299484e0-51e9-531b-a440-71ba80474df8 with identifier: TL72332
2026-03-28 18:34:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 299484e0-51e9-531b-a440-71ba80474df8 with identifier: TL72332 to the API
2026-03-28 18:34:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:47:43Z',
 'fuel_type': 'diesel',
 'id': '299484e0-51e9-531b-a440-71ba80474df8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL72332',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 116584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-07',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Seduction',
 'transmission': 'manual',
 'trim': 'Seduction',
 'year': 2015}
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72332%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Saving data for TL72332: {'auction_closing_time': 1774885663.0, 'created_time': 1773427538.032892, 'last_price_update_time': 1774722847.111368}
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL72332') HTTP/1.1" 204 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA00536%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for UA00536: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA95886%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for YA95886: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY52590%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for PY52590: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC31038%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for WC31038: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC37503%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for LC37503: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR89143%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for HR89143: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW16724%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for WW16724: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68578%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for DW68578: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT78140%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for ZT78140: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for ZN20945: 2
2026-03-28 18:34:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with identifier: ZN20945
2026-03-28 18:34:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with scrape type 2
2026-03-28 18:34:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with scrape type 2
2026-03-28 18:34:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8, identifier: ZN20945
2026-03-28 18:34:07 [scrapy.extensions.logstats] INFO: Crawled 113 pages (at 25 pages/min), scraped 248 items (at 54 items/min)
2026-03-28 18:34:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-28 18:34:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with identifier: ZN20945
2026-03-28 18:34:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with identifier: ZN20945
2026-03-28 18:34:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74b58880-2cf5-519a-8be9-4ab63dd4f4d8 with identifier: ZN20945 to the API
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:13:47Z',
 'fuel_type': 'diesel',
 'id': '74b58880-2cf5-519a-8be9-4ab63dd4f4d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN20945',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 128955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-12',
 'seller_name': None,
 'title': 'Smart fortwo 0.8 CDI Passion',
 'transmission': 'automatic',
 'trim': 'Passion',
 'year': 2012}
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN20945%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Saving data for ZN20945: {'auction_closing_time': 1774883627.0, 'created_time': 1774521431.049115, 'last_price_update_time': 1774722847.733408}
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN20945') HTTP/1.1" 204 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB73354%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for AB73354: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ38214%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for PJ38214: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK50983%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for LK50983: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT86021%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for JT86021: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY70814%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for MY70814: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE52893%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for SE52893: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92301%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for BD92301: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL90122%27 HTTP/1.1" 200 None
2026-03-28 18:34:07 [auto1.de] INFO: Scrape type for TL90122: 0
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-28 18:34:07 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-28 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX48260%27 HTTP/1.1" 200 None
2026-03-28 18:34:08 [auto1.de] INFO: Scrape type for TX48260: 0
2026-03-28 18:34:08 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-28 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61437%27 HTTP/1.1" 200 None
2026-03-28 18:34:08 [auto1.de] INFO: Scrape type for KZ61437: 0
2026-03-28 18:34:08 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-28 18:34:08 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-28 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14470%27 HTTP/1.1" 200 None
2026-03-28 18:34:08 [auto1.de] INFO: Scrape type for ZG14470: 0
2026-03-28 18:34:08 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-28 18:34:08 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-28 18:34:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:09 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 5996 | hits on page: 40
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ19127%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for WZ19127: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH16330%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for PH16330: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV62833%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for AV62833: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA63751%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for PA63751: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT44889%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for CT44889: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL19137%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for KL19137: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC63229%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for LC63229: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63339%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for WC63339: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN72199%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for SN72199: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ03455%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for YJ03455: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46012%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for MV46012: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ40966%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for PZ40966: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ74150%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for EJ74150: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX17219%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for MX17219: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD58874%27 HTTP/1.1" 200 None
2026-03-28 18:34:09 [auto1.de] INFO: Scrape type for KD58874: 0
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-28 18:34:09 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-28 18:34:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:10 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 5996 | hits on page: 40
2026-03-28 18:34:10 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-28 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ32658%27 HTTP/1.1" 200 None
2026-03-28 18:34:10 [auto1.de] INFO: Scrape type for HZ32658: 0
2026-03-28 18:34:10 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-28 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF11378%27 HTTP/1.1" 200 None
2026-03-28 18:34:10 [auto1.de] INFO: Scrape type for FF11378: 0
2026-03-28 18:34:10 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-28 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-28 18:34:10 [auto1.de] INFO: Scrape type for WF56073: 2
2026-03-28 18:34:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4675084-2021-5fec-8f4e-a6aeb256b079 with identifier: WF56073
2026-03-28 18:34:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4675084-2021-5fec-8f4e-a6aeb256b079 with scrape type 2
2026-03-28 18:34:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4675084-2021-5fec-8f4e-a6aeb256b079 with scrape type 2
2026-03-28 18:34:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4675084-2021-5fec-8f4e-a6aeb256b079, identifier: WF56073
2026-03-28 18:34:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4675084-2021-5fec-8f4e-a6aeb256b079 with identifier: WF56073
2026-03-28 18:34:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4675084-2021-5fec-8f4e-a6aeb256b079 with identifier: WF56073
2026-03-28 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4675084-2021-5fec-8f4e-a6aeb256b079 with identifier: WF56073 to the API
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:39:11Z',
 'fuel_type': 'diesel',
 'id': 'c4675084-2021-5fec-8f4e-a6aeb256b079',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF56073',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 123162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-26',
 'seller_name': None,
 'title': 'Audi A6 2.7 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF56073%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Saving data for WF56073: {'auction_closing_time': 1774885151.0, 'created_time': 1774521689.329279, 'last_price_update_time': 1774722851.261184}
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF56073') HTTP/1.1" 204 0
2026-03-28 18:34:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG53147%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for SG53147: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG52240%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for NG52240: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN47860%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for SN47860: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31302%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for WF31302: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW19119%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for VW19119: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for TP00598: 2
2026-03-28 18:34:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48f7e4cc-2684-5ce4-8c88-d32217415838 with identifier: TP00598
2026-03-28 18:34:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48f7e4cc-2684-5ce4-8c88-d32217415838 with scrape type 2
2026-03-28 18:34:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48f7e4cc-2684-5ce4-8c88-d32217415838 with scrape type 2
2026-03-28 18:34:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48f7e4cc-2684-5ce4-8c88-d32217415838, identifier: TP00598
2026-03-28 18:34:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48f7e4cc-2684-5ce4-8c88-d32217415838 with identifier: TP00598
2026-03-28 18:34:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48f7e4cc-2684-5ce4-8c88-d32217415838 with identifier: TP00598
2026-03-28 18:34:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48f7e4cc-2684-5ce4-8c88-d32217415838 with identifier: TP00598 to the API
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:23:16Z',
 'fuel_type': 'diesel',
 'id': '48f7e4cc-2684-5ce4-8c88-d32217415838',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP00598',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 109258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Cup BlueMotion',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion',
 'year': 2015}
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP00598%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Saving data for TP00598: {'auction_closing_time': 1774884196.0, 'created_time': 1774349451.97668, 'last_price_update_time': 1774722851.901038}
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP00598') HTTP/1.1" 204 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB50161%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for XB50161: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63476%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for LD63476: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86869%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for YB86869: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP68218%27 HTTP/1.1" 200 None
2026-03-28 18:34:11 [auto1.de] INFO: Scrape type for GP68218: 0
2026-03-28 18:34:11 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-28 18:34:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF34057%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for NF34057: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ62576%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for XJ62576: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD44435%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for MD44435: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL19525%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for HL19525: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80862%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for EJ80862: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for WY73016: 2
2026-03-28 18:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55ad151-60f0-5448-8465-7c814cf29433 with identifier: WY73016
2026-03-28 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55ad151-60f0-5448-8465-7c814cf29433 with scrape type 2
2026-03-28 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b55ad151-60f0-5448-8465-7c814cf29433 with scrape type 2
2026-03-28 18:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b55ad151-60f0-5448-8465-7c814cf29433, identifier: WY73016
2026-03-28 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b55ad151-60f0-5448-8465-7c814cf29433 with identifier: WY73016
2026-03-28 18:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b55ad151-60f0-5448-8465-7c814cf29433 with identifier: WY73016
2026-03-28 18:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b55ad151-60f0-5448-8465-7c814cf29433 with identifier: WY73016 to the API
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:25Z',
 'fuel_type': 'diesel',
 'id': 'b55ad151-60f0-5448-8465-7c814cf29433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY73016',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 228288,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-24',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2010}
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY73016%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Saving data for WY73016: {'auction_closing_time': 1774886125.0, 'created_time': 1774636283.656998, 'last_price_update_time': 1774722852.482151}
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY73016') HTTP/1.1" 204 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV33449%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for ZV33449: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE64290%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for AE64290: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78766%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for FJ78766: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS22515%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for BS22515: 0
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-28 18:34:12 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-28 18:34:12 [auto1.de] INFO: Scrape type for GK43362: 2
2026-03-28 18:34:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with identifier: GK43362
2026-03-28 18:34:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with scrape type 2
2026-03-28 18:34:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with scrape type 2
2026-03-28 18:34:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0c5ea27-4335-53d3-b302-0cc37e3edbe4, identifier: GK43362
2026-03-28 18:34:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with identifier: GK43362
2026-03-28 18:34:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with identifier: GK43362
2026-03-28 18:34:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0c5ea27-4335-53d3-b302-0cc37e3edbe4 with identifier: GK43362 to the API
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:22:04Z',
 'fuel_type': 'petrol',
 'id': 'f0c5ea27-4335-53d3-b302-0cc37e3edbe4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK43362',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 allstreet',
 'odometer': 14702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-14',
 'seller_name': None,
 'title': 'Audi A1 allstreet 30 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2024}
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK43362%27 HTTP/1.1" 200 None
2026-03-28 18:34:13 [auto1.de] INFO: Saving data for GK43362: {'auction_closing_time': 1774884124.0, 'created_time': 1773431711.950617, 'last_price_update_time': 1774722853.09506}
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK43362') HTTP/1.1" 204 0
2026-03-28 18:34:13 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL88078%27 HTTP/1.1" 200 None
2026-03-28 18:34:13 [auto1.de] INFO: Scrape type for NL88078: 0
2026-03-28 18:34:13 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-28 18:34:13 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS02487%27 HTTP/1.1" 200 None
2026-03-28 18:34:13 [auto1.de] INFO: Scrape type for WS02487: 0
2026-03-28 18:34:13 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-28 18:34:13 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-28 18:34:13 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-28 18:34:13 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ85797%27 HTTP/1.1" 200 None
2026-03-28 18:34:13 [auto1.de] INFO: Scrape type for EZ85797: 0
2026-03-28 18:34:13 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET35150%27 HTTP/1.1" 200 None
2026-03-28 18:34:13 [auto1.de] INFO: Scrape type for ET35150: 0
2026-03-28 18:34:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:14 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 5996 | hits on page: 40
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW19006%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for CW19006: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV33173%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for NV33173: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA55190%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for SA55190: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF96299%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for PF96299: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX05285%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for BX05285: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ94089%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for EZ94089: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU16473%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for KU16473: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX40120%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for JX40120: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX81073%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for JX81073: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78300%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for PL78300: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD34962%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for KD34962: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59339%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for GM59339: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES44709%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for ES44709: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT90816%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for PT90816: 0
2026-03-28 18:34:14 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE69852%27 HTTP/1.1" 200 None
2026-03-28 18:34:14 [auto1.de] INFO: Scrape type for YE69852: 0
2026-03-28 18:34:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:15 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 5996 | hits on page: 40
2026-03-28 18:34:15 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-28 18:34:15 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-28 18:34:15 [auto1.de] INFO: Scrape type for VS72441: 2
2026-03-28 18:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with identifier: VS72441
2026-03-28 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with scrape type 2
2026-03-28 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with scrape type 2
2026-03-28 18:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5ac95aa-aff8-5e6f-98b6-d15b02391b51, identifier: VS72441
2026-03-28 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with identifier: VS72441
2026-03-28 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with identifier: VS72441
2026-03-28 18:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5ac95aa-aff8-5e6f-98b6-d15b02391b51 with identifier: VS72441 to the API
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:46:43Z',
 'fuel_type': 'diesel',
 'id': 'c5ac95aa-aff8-5e6f-98b6-d15b02391b51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS72441',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-09',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS72441%27 HTTP/1.1" 200 None
2026-03-28 18:34:15 [auto1.de] INFO: Saving data for VS72441: {'auction_closing_time': 1774885603.0, 'created_time': 1774002477.086803, 'last_price_update_time': 1774722855.616908}
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS72441') HTTP/1.1" 204 0
2026-03-28 18:34:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:15 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE81559%27 HTTP/1.1" 200 None
2026-03-28 18:34:15 [auto1.de] INFO: Scrape type for JE81559: 0
2026-03-28 18:34:15 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-28 18:34:15 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND35935%27 HTTP/1.1" 200 None
2026-03-28 18:34:15 [auto1.de] INFO: Scrape type for ND35935: 0
2026-03-28 18:34:15 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-28 18:34:15 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-28 18:34:15 [auto1.de] INFO: Scrape type for AM19734: 2
2026-03-28 18:34:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-03-28 18:34:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with scrape type 2
2026-03-28 18:34:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with scrape type 2
2026-03-28 18:34:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebb424d4-0ed7-5cfc-965f-05578a6c5c87, identifier: AM19734
2026-03-28 18:34:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-03-28 18:34:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734
2026-03-28 18:34:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebb424d4-0ed7-5cfc-965f-05578a6c5c87 with identifier: AM19734 to the API
2026-03-28 18:34:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:44:19Z',
 'fuel_type': 'petrol',
 'id': 'ebb424d4-0ed7-5cfc-965f-05578a6c5c87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM19734',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra GTC',
 'odometer': 92533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-11',
 'seller_name': None,
 'title': 'Opel Astra GTC 1.6 SIDI Turbo Excite',
 'transmission': 'manual',
 'trim': 'Excite',
 'year': 2018}
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM19734%27 HTTP/1.1" 200 None
2026-03-28 18:34:16 [auto1.de] INFO: Saving data for AM19734: {'auction_closing_time': 1774885459.0, 'created_time': 1774522454.559434, 'last_price_update_time': 1774722856.223107}
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM19734') HTTP/1.1" 204 0
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU29731%27 HTTP/1.1" 200 None
2026-03-28 18:34:16 [auto1.de] INFO: Scrape type for HU29731: 0
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-28 18:34:16 [auto1.de] INFO: Scrape type for MA76308: 2
2026-03-28 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with identifier: MA76308
2026-03-28 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with scrape type 2
2026-03-28 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with scrape type 2
2026-03-28 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a, identifier: MA76308
2026-03-28 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with identifier: MA76308
2026-03-28 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with identifier: MA76308
2026-03-28 18:34:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7763ac02-d16a-5e4d-bbe7-d23acbd6f92a with identifier: MA76308 to the API
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:46:45Z',
 'fuel_type': 'petrol',
 'id': '7763ac02-d16a-5e4d-bbe7-d23acbd6f92a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA76308',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 190467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-16',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex 4x4',
 'year': 2013}
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA76308%27 HTTP/1.1" 200 None
2026-03-28 18:34:16 [auto1.de] INFO: Saving data for MA76308: {'auction_closing_time': 1774885605.0, 'created_time': 1774521473.730929, 'last_price_update_time': 1774722856.674778}
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA76308') HTTP/1.1" 204 0
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ52700%27 HTTP/1.1" 200 None
2026-03-28 18:34:16 [auto1.de] INFO: Scrape type for UZ52700: 0
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82659%27 HTTP/1.1" 200 None
2026-03-28 18:34:16 [auto1.de] INFO: Scrape type for PS82659: 0
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-28 18:34:16 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-28 18:34:16 [auto1.de] INFO: Scrape type for XC25059: 2
2026-03-28 18:34:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with identifier: XC25059
2026-03-28 18:34:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with scrape type 2
2026-03-28 18:34:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with scrape type 2
2026-03-28 18:34:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3d6a5e6-b09b-593f-ac88-edd42ee3a823, identifier: XC25059
2026-03-28 18:34:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with identifier: XC25059
2026-03-28 18:34:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with identifier: XC25059
2026-03-28 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3d6a5e6-b09b-593f-ac88-edd42ee3a823 with identifier: XC25059 to the API
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:31:33Z',
 'fuel_type': 'diesel',
 'id': 'c3d6a5e6-b09b-593f-ac88-edd42ee3a823',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC25059',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 192141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC25059%27 HTTP/1.1" 200 None
2026-03-28 18:34:17 [auto1.de] INFO: Saving data for XC25059: {'auction_closing_time': 1774884693.0, 'created_time': 1774032371.848973, 'last_price_update_time': 1774722857.223921}
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC25059') HTTP/1.1" 204 0
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-28 18:34:17 [auto1.de] INFO: Scrape type for NH67676: 2
2026-03-28 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b9b9c8f-c935-572f-affe-2848805b84a2 with identifier: NH67676
2026-03-28 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b9b9c8f-c935-572f-affe-2848805b84a2 with scrape type 2
2026-03-28 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b9b9c8f-c935-572f-affe-2848805b84a2 with scrape type 2
2026-03-28 18:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b9b9c8f-c935-572f-affe-2848805b84a2, identifier: NH67676
2026-03-28 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b9b9c8f-c935-572f-affe-2848805b84a2 with identifier: NH67676
2026-03-28 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b9b9c8f-c935-572f-affe-2848805b84a2 with identifier: NH67676
2026-03-28 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b9b9c8f-c935-572f-affe-2848805b84a2 with identifier: NH67676 to the API
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:52:30Z',
 'fuel_type': 'diesel',
 'id': '7b9b9c8f-c935-572f-affe-2848805b84a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH67676',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 169358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2018}
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH67676%27 HTTP/1.1" 200 None
2026-03-28 18:34:17 [auto1.de] INFO: Saving data for NH67676: {'auction_closing_time': 1774885950.0, 'created_time': 1773387051.630934, 'last_price_update_time': 1774722857.670532}
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH67676') HTTP/1.1" 204 0
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40216%27 HTTP/1.1" 200 None
2026-03-28 18:34:17 [auto1.de] INFO: Scrape type for TX40216: 0
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-28 18:34:17 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-28 18:34:17 [auto1.de] INFO: Scrape type for DJ81890: 2
2026-03-28 18:34:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caac9d88-d390-596a-9f59-fa11e41fe052 with identifier: DJ81890
2026-03-28 18:34:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caac9d88-d390-596a-9f59-fa11e41fe052 with scrape type 2
2026-03-28 18:34:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caac9d88-d390-596a-9f59-fa11e41fe052 with scrape type 2
2026-03-28 18:34:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caac9d88-d390-596a-9f59-fa11e41fe052, identifier: DJ81890
2026-03-28 18:34:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caac9d88-d390-596a-9f59-fa11e41fe052 with identifier: DJ81890
2026-03-28 18:34:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caac9d88-d390-596a-9f59-fa11e41fe052 with identifier: DJ81890
2026-03-28 18:34:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caac9d88-d390-596a-9f59-fa11e41fe052 with identifier: DJ81890 to the API
2026-03-28 18:34:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:45:32Z',
 'fuel_type': 'diesel',
 'id': 'caac9d88-d390-596a-9f59-fa11e41fe052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ81890',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 239152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-22',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TDI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ81890%27 HTTP/1.1" 200 None
2026-03-28 18:34:18 [auto1.de] INFO: Saving data for DJ81890: {'auction_closing_time': 1774885532.0, 'created_time': 1773381813.702166, 'last_price_update_time': 1774722858.131271}
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ81890') HTTP/1.1" 204 0
2026-03-28 18:34:18 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-28 18:34:18 [auto1.de] INFO: Scrape type for AD30182: 2
2026-03-28 18:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with identifier: AD30182
2026-03-28 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with scrape type 2
2026-03-28 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with scrape type 2
2026-03-28 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040, identifier: AD30182
2026-03-28 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with identifier: AD30182
2026-03-28 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with identifier: AD30182
2026-03-28 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040 with identifier: AD30182 to the API
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:41:31Z',
 'fuel_type': 'petrol',
 'id': 'dd2fbe44-b02a-5a44-9a5d-d61fc6ef3040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD30182',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 12491,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-16',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2023}
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD30182%27 HTTP/1.1" 200 None
2026-03-28 18:34:18 [auto1.de] INFO: Saving data for AD30182: {'auction_closing_time': 1774885291.0, 'created_time': 1773426724.370823, 'last_price_update_time': 1774722858.662089}
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD30182') HTTP/1.1" 204 0
2026-03-28 18:34:18 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-28 18:34:18 [auto1.de] INFO: Scrape type for LX22574: 2
2026-03-28 18:34:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 819b4303-1aea-55b9-b2b3-cba9f2876e21 with identifier: LX22574
2026-03-28 18:34:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 819b4303-1aea-55b9-b2b3-cba9f2876e21 with scrape type 2
2026-03-28 18:34:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 819b4303-1aea-55b9-b2b3-cba9f2876e21 with scrape type 2
2026-03-28 18:34:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 819b4303-1aea-55b9-b2b3-cba9f2876e21, identifier: LX22574
2026-03-28 18:34:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 819b4303-1aea-55b9-b2b3-cba9f2876e21 with identifier: LX22574
2026-03-28 18:34:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 819b4303-1aea-55b9-b2b3-cba9f2876e21 with identifier: LX22574
2026-03-28 18:34:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 819b4303-1aea-55b9-b2b3-cba9f2876e21 with identifier: LX22574 to the API
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:14:51Z',
 'fuel_type': 'petrol',
 'id': '819b4303-1aea-55b9-b2b3-cba9f2876e21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX22574',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 110298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-31',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX22574%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Saving data for LX22574: {'auction_closing_time': 1774883691.0, 'created_time': 1774522146.03296, 'last_price_update_time': 1774722859.093293}
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX22574') HTTP/1.1" 204 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52961%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for TJ52961: 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV52918%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for LV52918: 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for PW08848: 2
2026-03-28 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0df00137-405a-52fb-962e-912255d3c216 with identifier: PW08848
2026-03-28 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0df00137-405a-52fb-962e-912255d3c216 with scrape type 2
2026-03-28 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0df00137-405a-52fb-962e-912255d3c216 with scrape type 2
2026-03-28 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0df00137-405a-52fb-962e-912255d3c216, identifier: PW08848
2026-03-28 18:34:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0df00137-405a-52fb-962e-912255d3c216 with identifier: PW08848
2026-03-28 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0df00137-405a-52fb-962e-912255d3c216 with identifier: PW08848
2026-03-28 18:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0df00137-405a-52fb-962e-912255d3c216 with identifier: PW08848 to the API
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:18:15Z',
 'fuel_type': 'diesel',
 'id': '0df00137-405a-52fb-962e-912255d3c216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW08848',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 290571,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-09',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CDI T 4Matic BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW08848%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Saving data for PW08848: {'auction_closing_time': 1774883895.0, 'created_time': 1773428693.773969, 'last_price_update_time': 1774722859.575513}
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW08848') HTTP/1.1" 204 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL92844%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for YL92844: 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 18:34:19 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 5997 | hits on page: 40
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK27476%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for CK27476: 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN68791%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for AN68791: 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP68179%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for SP68179: 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT27416%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for NT27416: 0
2026-03-28 18:34:19 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-28 18:34:19 [auto1.de] INFO: Scrape type for TY58494: 2
2026-03-28 18:34:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ac855b-982f-5303-b3c4-a4cb8a38e986 with identifier: TY58494
2026-03-28 18:34:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ac855b-982f-5303-b3c4-a4cb8a38e986 with scrape type 2
2026-03-28 18:34:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05ac855b-982f-5303-b3c4-a4cb8a38e986 with scrape type 2
2026-03-28 18:34:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05ac855b-982f-5303-b3c4-a4cb8a38e986, identifier: TY58494
2026-03-28 18:34:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05ac855b-982f-5303-b3c4-a4cb8a38e986 with identifier: TY58494
2026-03-28 18:34:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05ac855b-982f-5303-b3c4-a4cb8a38e986 with identifier: TY58494
2026-03-28 18:34:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05ac855b-982f-5303-b3c4-a4cb8a38e986 with identifier: TY58494 to the API
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:07Z',
 'fuel_type': 'petrol',
 'id': '05ac855b-982f-5303-b3c4-a4cb8a38e986',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY58494',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 57734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-13',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2022}
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY58494%27 HTTP/1.1" 200 None
2026-03-28 18:34:20 [auto1.de] INFO: Saving data for TY58494: {'auction_closing_time': 1774884727.0, 'created_time': 1774636239.429135, 'last_price_update_time': 1774722860.092138}
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY58494') HTTP/1.1" 204 0
2026-03-28 18:34:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:20 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM48488%27 HTTP/1.1" 200 None
2026-03-28 18:34:20 [auto1.de] INFO: Scrape type for UM48488: 0
2026-03-28 18:34:20 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-28 18:34:20 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-28 18:34:20 [auto1.de] INFO: Scrape type for EU37880: 2
2026-03-28 18:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 199990d2-101a-535e-b4bf-7340d288ce39 with identifier: EU37880
2026-03-28 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 199990d2-101a-535e-b4bf-7340d288ce39 with scrape type 2
2026-03-28 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 199990d2-101a-535e-b4bf-7340d288ce39 with scrape type 2
2026-03-28 18:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 199990d2-101a-535e-b4bf-7340d288ce39, identifier: EU37880
2026-03-28 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 199990d2-101a-535e-b4bf-7340d288ce39 with identifier: EU37880
2026-03-28 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 199990d2-101a-535e-b4bf-7340d288ce39 with identifier: EU37880
2026-03-28 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 199990d2-101a-535e-b4bf-7340d288ce39 with identifier: EU37880 to the API
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:58:55Z',
 'fuel_type': 'diesel',
 'id': '199990d2-101a-535e-b4bf-7340d288ce39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU37880',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 102911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-25',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.0 Blue-HDi 435 L3 BlueHDi 130 Kipper Edition',
 'transmission': 'manual',
 'trim': '435 L3 BlueHDi 130 Kipper Edition',
 'year': 2018}
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU37880%27 HTTP/1.1" 200 None
2026-03-28 18:34:20 [auto1.de] INFO: Saving data for EU37880: {'auction_closing_time': 1774886335.0, 'created_time': 1774521881.722705, 'last_price_update_time': 1774722860.630396}
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU37880') HTTP/1.1" 204 0
2026-03-28 18:34:20 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-28 18:34:20 [auto1.de] INFO: Scrape type for CD36674: 2
2026-03-28 18:34:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f75486b-1915-5a90-a228-1b787df727b5 with identifier: CD36674
2026-03-28 18:34:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f75486b-1915-5a90-a228-1b787df727b5 with scrape type 2
2026-03-28 18:34:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f75486b-1915-5a90-a228-1b787df727b5 with scrape type 2
2026-03-28 18:34:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f75486b-1915-5a90-a228-1b787df727b5, identifier: CD36674
2026-03-28 18:34:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f75486b-1915-5a90-a228-1b787df727b5 with identifier: CD36674
2026-03-28 18:34:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f75486b-1915-5a90-a228-1b787df727b5 with identifier: CD36674
2026-03-28 18:34:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f75486b-1915-5a90-a228-1b787df727b5 with identifier: CD36674 to the API
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:38:52Z',
 'fuel_type': 'diesel',
 'id': '8f75486b-1915-5a90-a228-1b787df727b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD36674',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 220192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-15',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36674%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Saving data for CD36674: {'auction_closing_time': 1774885132.0, 'created_time': 1774636324.563795, 'last_price_update_time': 1774722861.0453}
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD36674') HTTP/1.1" 204 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK54405%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for SK54405: 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW62126%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for NW62126: 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35044%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for JG35044: 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW05751%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for BW05751: 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV40367%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for ZV40367: 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG94093%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for XG94093: 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT90802%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for MT90802: 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY58997%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for UY58997: 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for CE31107: 2
2026-03-28 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-03-28 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with scrape type 2
2026-03-28 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with scrape type 2
2026-03-28 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3, identifier: CE31107
2026-03-28 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-03-28 18:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107
2026-03-28 18:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3 with identifier: CE31107 to the API
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:16:40Z',
 'fuel_type': 'petrol',
 'id': 'e1b8650c-a75b-5e22-a6f6-bc17fe97b6b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE31107',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 75293,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2017}
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE31107%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Saving data for CE31107: {'auction_closing_time': 1774883800.0, 'created_time': 1773427120.804391, 'last_price_update_time': 1774722861.646235}
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE31107') HTTP/1.1" 204 0
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-28 18:34:21 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-28 18:34:21 [auto1.de] INFO: Scrape type for SY19126: 2
2026-03-28 18:34:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with identifier: SY19126
2026-03-28 18:34:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with scrape type 2
2026-03-28 18:34:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with scrape type 2
2026-03-28 18:34:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbb998a-0b1e-594c-8e11-8e0b75d33d63, identifier: SY19126
2026-03-28 18:34:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with identifier: SY19126
2026-03-28 18:34:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with identifier: SY19126
2026-03-28 18:34:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbb998a-0b1e-594c-8e11-8e0b75d33d63 with identifier: SY19126 to the API
2026-03-28 18:34:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:59:00Z',
 'fuel_type': 'diesel',
 'id': 'cdbb998a-0b1e-594c-8e11-8e0b75d33d63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY19126',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 125706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-12',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI M Tourer L2',
 'transmission': 'automatic',
 'trim': 'M Tourer L2',
 'year': 2022}
2026-03-28 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY19126%27 HTTP/1.1" 200 None
2026-03-28 18:34:22 [auto1.de] INFO: Saving data for SY19126: {'auction_closing_time': 1774886340.0, 'created_time': 1774636396.352895, 'last_price_update_time': 1774722862.199729}
2026-03-28 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY19126') HTTP/1.1" 204 0
2026-03-28 18:34:22 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-28 18:34:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:23 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN03285%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for BN03285: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ04450%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for SZ04450: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG96622%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for KG96622: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for MM04684: 2
2026-03-28 18:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 541bf046-305f-5b56-9571-ed738b024aed with identifier: MM04684
2026-03-28 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 541bf046-305f-5b56-9571-ed738b024aed with scrape type 2
2026-03-28 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 541bf046-305f-5b56-9571-ed738b024aed with scrape type 2
2026-03-28 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 541bf046-305f-5b56-9571-ed738b024aed, identifier: MM04684
2026-03-28 18:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 541bf046-305f-5b56-9571-ed738b024aed with identifier: MM04684
2026-03-28 18:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 541bf046-305f-5b56-9571-ed738b024aed with identifier: MM04684
2026-03-28 18:34:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 541bf046-305f-5b56-9571-ed738b024aed with identifier: MM04684 to the API
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:24:18Z',
 'fuel_type': 'diesel',
 'id': '541bf046-305f-5b56-9571-ed738b024aed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM04684',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 283661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-10-01',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.9 TDI Highline 4Motion',
 'transmission': 'manual',
 'trim': 'Highline 4Motion',
 'year': 2000}
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04684%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Saving data for MM04684: {'auction_closing_time': 1774884258.0, 'created_time': 1774032634.903096, 'last_price_update_time': 1774722863.529599}
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM04684') HTTP/1.1" 204 0
2026-03-28 18:34:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN92851%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for FN92851: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47887%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for HF47887: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP78953%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for WP78953: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH62859%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for EH62859: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN47046%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for EN47046: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR50786%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for PR50786: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU57618%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for ZU57618: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ71499%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for ZJ71499: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG74932%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for RG74932: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV67104%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for MV67104: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF55359%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for CF55359: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK88230%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for GK88230: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX45168%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for LX45168: 0
2026-03-28 18:34:23 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-28 18:34:23 [auto1.de] INFO: Scrape type for BX95848: 2
2026-03-28 18:34:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with identifier: BX95848
2026-03-28 18:34:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with scrape type 2
2026-03-28 18:34:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with scrape type 2
2026-03-28 18:34:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0, identifier: BX95848
2026-03-28 18:34:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with identifier: BX95848
2026-03-28 18:34:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with identifier: BX95848
2026-03-28 18:34:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0 with identifier: BX95848 to the API
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:54:31Z',
 'fuel_type': 'petrol',
 'id': '5b8eea6c-9d36-5723-8f0b-0db1faa8f0e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX95848',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 16835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-26',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX95848%27 HTTP/1.1" 200 None
2026-03-28 18:34:24 [auto1.de] INFO: Saving data for BX95848: {'auction_closing_time': 1774886071.0, 'created_time': 1774349171.574597, 'last_price_update_time': 1774722864.285293}
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX95848') HTTP/1.1" 204 0
2026-03-28 18:34:24 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-28 18:34:24 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ36531%27 HTTP/1.1" 200 None
2026-03-28 18:34:24 [auto1.de] INFO: Scrape type for DZ36531: 0
2026-03-28 18:34:24 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU73518%27 HTTP/1.1" 200 None
2026-03-28 18:34:24 [auto1.de] INFO: Scrape type for UU73518: 0
2026-03-28 18:34:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:25 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM77164%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for XM77164: 0
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD14897%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for HD14897: 0
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU35907%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for UU35907: 0
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL38204%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for ZL38204: 0
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ93039%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for DZ93039: 0
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG38936%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for AG38936: 0
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91085%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for XT91085: 0
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ15757%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for CJ15757: 0
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-28 18:34:25 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-28 18:34:25 [auto1.de] INFO: Scrape type for ZE67546: 2
2026-03-28 18:34:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04ddceaa-8240-5c23-99a5-b60a774b0062 with identifier: ZE67546
2026-03-28 18:34:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04ddceaa-8240-5c23-99a5-b60a774b0062 with scrape type 2
2026-03-28 18:34:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04ddceaa-8240-5c23-99a5-b60a774b0062 with scrape type 2
2026-03-28 18:34:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04ddceaa-8240-5c23-99a5-b60a774b0062, identifier: ZE67546
2026-03-28 18:34:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04ddceaa-8240-5c23-99a5-b60a774b0062 with identifier: ZE67546
2026-03-28 18:34:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04ddceaa-8240-5c23-99a5-b60a774b0062 with identifier: ZE67546
2026-03-28 18:34:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04ddceaa-8240-5c23-99a5-b60a774b0062 with identifier: ZE67546 to the API
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:17:37Z',
 'fuel_type': 'hybrid',
 'id': '04ddceaa-8240-5c23-99a5-b60a774b0062',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE67546',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 55216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE67546%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Saving data for ZE67546: {'auction_closing_time': 1774883857.0, 'created_time': 1773428774.636892, 'last_price_update_time': 1774722866.067067}
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE67546') HTTP/1.1" 204 0
2026-03-28 18:34:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC08315%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for GC08315: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ66272%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for MJ66272: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN96798%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for DN96798: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA14400%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for DA14400: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX08266%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for ZX08266: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF58855%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for XF58855: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW69940%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for BW69940: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT26189%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for JT26189: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW88691%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for YW88691: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN31203%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for PN31203: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for GL29302: 2
2026-03-28 18:34:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22ed6070-9994-531d-8c93-416057fdd47e with identifier: GL29302
2026-03-28 18:34:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22ed6070-9994-531d-8c93-416057fdd47e with scrape type 2
2026-03-28 18:34:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22ed6070-9994-531d-8c93-416057fdd47e with scrape type 2
2026-03-28 18:34:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22ed6070-9994-531d-8c93-416057fdd47e, identifier: GL29302
2026-03-28 18:34:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22ed6070-9994-531d-8c93-416057fdd47e with identifier: GL29302
2026-03-28 18:34:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22ed6070-9994-531d-8c93-416057fdd47e with identifier: GL29302
2026-03-28 18:34:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22ed6070-9994-531d-8c93-416057fdd47e with identifier: GL29302 to the API
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:32:21Z',
 'fuel_type': 'petrol',
 'id': '22ed6070-9994-531d-8c93-416057fdd47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL29302',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 138869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-06',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2016}
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL29302%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Saving data for GL29302: {'auction_closing_time': 1774884741.0, 'created_time': 1774521385.417426, 'last_price_update_time': 1774722866.768117}
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL29302') HTTP/1.1" 204 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF85943%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for BF85943: 0
2026-03-28 18:34:26 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44518%27 HTTP/1.1" 200 None
2026-03-28 18:34:26 [auto1.de] INFO: Scrape type for YH44518: 0
2026-03-28 18:34:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:27 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:27 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-28 18:34:27 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-28 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM46602%27 HTTP/1.1" 200 None
2026-03-28 18:34:27 [auto1.de] INFO: Scrape type for LM46602: 0
2026-03-28 18:34:27 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-28 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-28 18:34:27 [auto1.de] INFO: Scrape type for HA16942: 2
2026-03-28 18:34:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with identifier: HA16942
2026-03-28 18:34:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with scrape type 2
2026-03-28 18:34:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with scrape type 2
2026-03-28 18:34:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47, identifier: HA16942
2026-03-28 18:34:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with identifier: HA16942
2026-03-28 18:34:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with identifier: HA16942
2026-03-28 18:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14ccf64c-505d-5ce3-b9ce-c541f4f7ed47 with identifier: HA16942 to the API
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:02:26Z',
 'fuel_type': 'petrol',
 'id': '14ccf64c-505d-5ce3-b9ce-c541f4f7ed47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA16942',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 120283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA16942%27 HTTP/1.1" 200 None
2026-03-28 18:34:28 [auto1.de] INFO: Saving data for HA16942: {'auction_closing_time': 1774882946.0, 'created_time': 1774522491.297355, 'last_price_update_time': 1774722868.2356}
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA16942') HTTP/1.1" 204 0
2026-03-28 18:34:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:28 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-28 18:34:28 [auto1.de] INFO: Scrape type for VY57936: 2
2026-03-28 18:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with identifier: VY57936
2026-03-28 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with scrape type 2
2026-03-28 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with scrape type 2
2026-03-28 18:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3, identifier: VY57936
2026-03-28 18:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with identifier: VY57936
2026-03-28 18:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with identifier: VY57936
2026-03-28 18:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3 with identifier: VY57936 to the API
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:54:01Z',
 'fuel_type': 'diesel',
 'id': '659b3cb0-fe8b-5d1f-bdcc-e51e390fefb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY57936',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 181731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-03',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Tourer xDrive Advantage',
 'transmission': 'automatic',
 'trim': 'xDrive Advantage',
 'year': 2017}
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY57936%27 HTTP/1.1" 200 None
2026-03-28 18:34:28 [auto1.de] INFO: Saving data for VY57936: {'auction_closing_time': 1774886041.0, 'created_time': 1773468036.378788, 'last_price_update_time': 1774722868.693992}
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY57936') HTTP/1.1" 204 0
2026-03-28 18:34:28 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-28 18:34:28 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ85569%27 HTTP/1.1" 200 None
2026-03-28 18:34:28 [auto1.de] INFO: Scrape type for AJ85569: 0
2026-03-28 18:34:28 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-28 18:34:28 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-28 18:34:28 [auto1.de] INFO: Scrape type for EE67524: 2
2026-03-28 18:34:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f4565f-287b-59db-bf45-84986f23d96d with identifier: EE67524
2026-03-28 18:34:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f4565f-287b-59db-bf45-84986f23d96d with scrape type 2
2026-03-28 18:34:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f4565f-287b-59db-bf45-84986f23d96d with scrape type 2
2026-03-28 18:34:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06f4565f-287b-59db-bf45-84986f23d96d, identifier: EE67524
2026-03-28 18:34:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06f4565f-287b-59db-bf45-84986f23d96d with identifier: EE67524
2026-03-28 18:34:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06f4565f-287b-59db-bf45-84986f23d96d with identifier: EE67524
2026-03-28 18:34:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06f4565f-287b-59db-bf45-84986f23d96d with identifier: EE67524 to the API
2026-03-28 18:34:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:33Z',
 'fuel_type': 'petrol',
 'id': '06f4565f-287b-59db-bf45-84986f23d96d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE67524',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 164779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-08',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2015}
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE67524%27 HTTP/1.1" 200 None
2026-03-28 18:34:29 [auto1.de] INFO: Saving data for EE67524: {'auction_closing_time': 1774884333.0, 'created_time': 1774031778.177104, 'last_price_update_time': 1774722869.149514}
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE67524') HTTP/1.1" 204 0
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL30108%27 HTTP/1.1" 200 None
2026-03-28 18:34:29 [auto1.de] INFO: Scrape type for FL30108: 0
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61675%27 HTTP/1.1" 200 None
2026-03-28 18:34:29 [auto1.de] INFO: Scrape type for GL61675: 0
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-28 18:34:29 [auto1.de] INFO: Scrape type for NG74955: 2
2026-03-28 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8b9b66f-03aa-5432-a3de-9b881425e62d with identifier: NG74955
2026-03-28 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8b9b66f-03aa-5432-a3de-9b881425e62d with scrape type 2
2026-03-28 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8b9b66f-03aa-5432-a3de-9b881425e62d with scrape type 2
2026-03-28 18:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8b9b66f-03aa-5432-a3de-9b881425e62d, identifier: NG74955
2026-03-28 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8b9b66f-03aa-5432-a3de-9b881425e62d with identifier: NG74955
2026-03-28 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8b9b66f-03aa-5432-a3de-9b881425e62d with identifier: NG74955
2026-03-28 18:34:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8b9b66f-03aa-5432-a3de-9b881425e62d with identifier: NG74955 to the API
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:44:21Z',
 'fuel_type': 'petrol',
 'id': 'd8b9b66f-03aa-5432-a3de-9b881425e62d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG74955',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 177082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-16',
 'seller_name': None,
 'title': 'Mazda 6 2.3 Active Plus Sport',
 'transmission': 'automatic',
 'trim': 'Active Plus Sport',
 'year': 2007}
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG74955%27 HTTP/1.1" 200 None
2026-03-28 18:34:29 [auto1.de] INFO: Saving data for NG74955: {'auction_closing_time': 1774885461.0, 'created_time': 1774549898.137163, 'last_price_update_time': 1774722869.669429}
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG74955') HTTP/1.1" 204 0
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM69189%27 HTTP/1.1" 200 None
2026-03-28 18:34:29 [auto1.de] INFO: Scrape type for UM69189: 0
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH78642%27 HTTP/1.1" 200 None
2026-03-28 18:34:29 [auto1.de] INFO: Scrape type for VH78642: 0
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-28 18:34:29 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-28 18:34:29 [auto1.de] INFO: Scrape type for BW06132: 2
2026-03-28 18:34:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b5c9cd-4470-5647-bb3e-99797974a306 with identifier: BW06132
2026-03-28 18:34:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b5c9cd-4470-5647-bb3e-99797974a306 with scrape type 2
2026-03-28 18:34:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05b5c9cd-4470-5647-bb3e-99797974a306 with scrape type 2
2026-03-28 18:34:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05b5c9cd-4470-5647-bb3e-99797974a306, identifier: BW06132
2026-03-28 18:34:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05b5c9cd-4470-5647-bb3e-99797974a306 with identifier: BW06132
2026-03-28 18:34:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05b5c9cd-4470-5647-bb3e-99797974a306 with identifier: BW06132
2026-03-28 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05b5c9cd-4470-5647-bb3e-99797974a306 with identifier: BW06132 to the API
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:54Z',
 'fuel_type': 'petrol',
 'id': '05b5c9cd-4470-5647-bb3e-99797974a306',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW06132',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 216018,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-25',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2011}
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06132%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Saving data for BW06132: {'auction_closing_time': 1774883514.0, 'created_time': 1774118508.152529, 'last_price_update_time': 1774722870.217799}
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW06132') HTTP/1.1" 204 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW59742%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for CW59742: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC26510%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for TC26510: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP32439%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for FP32439: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV11727%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for TV11727: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ94391%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for WJ94391: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM78395%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for KM78395: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR86063%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for GR86063: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY67779%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for KY67779: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for LW85167: 2
2026-03-28 18:34:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 261d0056-5646-5775-a315-3a07f46f6bd2 with identifier: LW85167
2026-03-28 18:34:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 261d0056-5646-5775-a315-3a07f46f6bd2 with scrape type 2
2026-03-28 18:34:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 261d0056-5646-5775-a315-3a07f46f6bd2 with scrape type 2
2026-03-28 18:34:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 261d0056-5646-5775-a315-3a07f46f6bd2, identifier: LW85167
2026-03-28 18:34:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 261d0056-5646-5775-a315-3a07f46f6bd2 with identifier: LW85167
2026-03-28 18:34:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 261d0056-5646-5775-a315-3a07f46f6bd2 with identifier: LW85167
2026-03-28 18:34:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 261d0056-5646-5775-a315-3a07f46f6bd2 with identifier: LW85167 to the API
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:59:57Z',
 'fuel_type': 'petrol',
 'id': '261d0056-5646-5775-a315-3a07f46f6bd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW85167',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Splash',
 'odometer': 216673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-30',
 'seller_name': None,
 'title': 'Suzuki Splash 1.0 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2008}
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW85167%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Saving data for LW85167: {'auction_closing_time': 1774886397.0, 'created_time': 1774002760.477739, 'last_price_update_time': 1774722870.806604}
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW85167') HTTP/1.1" 204 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL85877%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for JL85877: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH78050%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for UH78050: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW13893%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for CW13893: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA25367%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for TA25367: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR31322%27 HTTP/1.1" 200 None
2026-03-28 18:34:30 [auto1.de] INFO: Scrape type for DR31322: 0
2026-03-28 18:34:30 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU21621%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for KU21621: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL26903%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for AL26903: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL58412%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for HL58412: 0
2026-03-28 18:34:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:31 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ09014%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for TJ09014: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML19559%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for ML19559: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR77795%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for SR77795: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD35771%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for AD35771: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN78353%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for PN78353: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF52264%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for TF52264: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW70056%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for PW70056: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for SM91292: 2
2026-03-28 18:34:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with identifier: SM91292
2026-03-28 18:34:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with scrape type 2
2026-03-28 18:34:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with scrape type 2
2026-03-28 18:34:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b, identifier: SM91292
2026-03-28 18:34:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with identifier: SM91292
2026-03-28 18:34:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with identifier: SM91292
2026-03-28 18:34:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d6c92ab-2942-5e8d-9cea-a5d483e0694b with identifier: SM91292 to the API
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:19:47Z',
 'fuel_type': 'petrol',
 'id': '2d6c92ab-2942-5e8d-9cea-a5d483e0694b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM91292',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 136220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-22',
 'seller_name': None,
 'title': 'BMW 1er 116i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2015}
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM91292%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Saving data for SM91292: {'auction_closing_time': 1774883987.0, 'created_time': 1773136782.948044, 'last_price_update_time': 1774722871.856493}
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM91292') HTTP/1.1" 204 0
2026-03-28 18:34:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH37368%27 HTTP/1.1" 200 None
2026-03-28 18:34:31 [auto1.de] INFO: Scrape type for AH37368: 0
2026-03-28 18:34:31 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-28 18:34:32 [auto1.de] INFO: Scrape type for FZ71323: 2
2026-03-28 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e83444-8747-5e75-8a01-38773a8e683b with identifier: FZ71323
2026-03-28 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e83444-8747-5e75-8a01-38773a8e683b with scrape type 2
2026-03-28 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69e83444-8747-5e75-8a01-38773a8e683b with scrape type 2
2026-03-28 18:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69e83444-8747-5e75-8a01-38773a8e683b, identifier: FZ71323
2026-03-28 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69e83444-8747-5e75-8a01-38773a8e683b with identifier: FZ71323
2026-03-28 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69e83444-8747-5e75-8a01-38773a8e683b with identifier: FZ71323
2026-03-28 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69e83444-8747-5e75-8a01-38773a8e683b with identifier: FZ71323 to the API
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:08Z',
 'fuel_type': 'diesel',
 'id': '69e83444-8747-5e75-8a01-38773a8e683b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ71323',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 106775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-13',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d EDITION lang',
 'transmission': 'automatic',
 'trim': 'EDITION lang',
 'year': 2022}
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ71323%27 HTTP/1.1" 200 None
2026-03-28 18:34:32 [auto1.de] INFO: Saving data for FZ71323: {'auction_closing_time': 1774884428.0, 'created_time': 1774521401.434355, 'last_price_update_time': 1774722872.409661}
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ71323') HTTP/1.1" 204 0
2026-03-28 18:34:32 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-28 18:34:32 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-28 18:34:32 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF84485%27 HTTP/1.1" 200 None
2026-03-28 18:34:32 [auto1.de] INFO: Scrape type for EF84485: 0
2026-03-28 18:34:32 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT68659%27 HTTP/1.1" 200 None
2026-03-28 18:34:32 [auto1.de] INFO: Scrape type for TT68659: 0
2026-03-28 18:34:32 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG87318%27 HTTP/1.1" 200 None
2026-03-28 18:34:32 [auto1.de] INFO: Scrape type for EG87318: 0
2026-03-28 18:34:32 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-28 18:34:32 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-28 18:34:32 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-28 18:34:32 [auto1.de] INFO: Scrape type for EG77695: 2
2026-03-28 18:34:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with identifier: EG77695
2026-03-28 18:34:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with scrape type 2
2026-03-28 18:34:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with scrape type 2
2026-03-28 18:34:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ea253c7-168e-5368-afdd-be01a1b6f0e4, identifier: EG77695
2026-03-28 18:34:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with identifier: EG77695
2026-03-28 18:34:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with identifier: EG77695
2026-03-28 18:34:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ea253c7-168e-5368-afdd-be01a1b6f0e4 with identifier: EG77695 to the API
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:21Z',
 'fuel_type': 'diesel',
 'id': '1ea253c7-168e-5368-afdd-be01a1b6f0e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG77695',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 301136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG77695%27 HTTP/1.1" 200 None
2026-03-28 18:34:32 [auto1.de] INFO: Saving data for EG77695: {'auction_closing_time': 1774883661.0, 'created_time': 1774118551.779824, 'last_price_update_time': 1774722872.912092}
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG77695') HTTP/1.1" 204 0
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-28 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC45623%27 HTTP/1.1" 200 None
2026-03-28 18:34:33 [auto1.de] INFO: Scrape type for WC45623: 0
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-28 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF48601%27 HTTP/1.1" 200 None
2026-03-28 18:34:33 [auto1.de] INFO: Scrape type for HF48601: 0
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-28 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW23670%27 HTTP/1.1" 200 None
2026-03-28 18:34:33 [auto1.de] INFO: Scrape type for DW23670: 0
2026-03-28 18:34:33 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-28 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH26233%27 HTTP/1.1" 200 None
2026-03-28 18:34:33 [auto1.de] INFO: Scrape type for VH26233: 0
2026-03-28 18:34:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:34 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:34 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA73417%27 HTTP/1.1" 200 None
2026-03-28 18:34:34 [auto1.de] INFO: Scrape type for BA73417: 0
2026-03-28 18:34:34 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-28 18:34:34 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-28 18:34:34 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-28 18:34:34 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-28 18:34:34 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR46383%27 HTTP/1.1" 200 None
2026-03-28 18:34:34 [auto1.de] INFO: Scrape type for RR46383: 0
2026-03-28 18:34:34 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY13477%27 HTTP/1.1" 200 None
2026-03-28 18:34:34 [auto1.de] INFO: Scrape type for UY13477: 0
2026-03-28 18:34:34 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-28 18:34:34 [auto1.de] INFO: Scrape type for WA19353: 2
2026-03-28 18:34:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with identifier: WA19353
2026-03-28 18:34:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with scrape type 2
2026-03-28 18:34:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with scrape type 2
2026-03-28 18:34:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872, identifier: WA19353
2026-03-28 18:34:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with identifier: WA19353
2026-03-28 18:34:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with identifier: WA19353
2026-03-28 18:34:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872 with identifier: WA19353 to the API
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:14:59Z',
 'fuel_type': 'petrol',
 'id': 'a7d19e7d-90b2-5ab6-bc6d-d2cdf5ae2872',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA19353',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 109832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-29',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA19353%27 HTTP/1.1" 200 None
2026-03-28 18:34:34 [auto1.de] INFO: Saving data for WA19353: {'auction_closing_time': 1774883699.0, 'created_time': 1774522065.347772, 'last_price_update_time': 1774722874.896206}
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA19353') HTTP/1.1" 204 0
2026-03-28 18:34:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN26192%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Scrape type for XN26192: 0
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM59511%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Scrape type for GM59511: 0
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL15649%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Scrape type for ZL15649: 0
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Scrape type for BL86865: 2
2026-03-28 18:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2000dfd-135c-5f32-97bd-030268e7db8f with identifier: BL86865
2026-03-28 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2000dfd-135c-5f32-97bd-030268e7db8f with scrape type 2
2026-03-28 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2000dfd-135c-5f32-97bd-030268e7db8f with scrape type 2
2026-03-28 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2000dfd-135c-5f32-97bd-030268e7db8f, identifier: BL86865
2026-03-28 18:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2000dfd-135c-5f32-97bd-030268e7db8f with identifier: BL86865
2026-03-28 18:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2000dfd-135c-5f32-97bd-030268e7db8f with identifier: BL86865
2026-03-28 18:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2000dfd-135c-5f32-97bd-030268e7db8f with identifier: BL86865 to the API
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:35Z',
 'fuel_type': 'petrol',
 'id': 'a2000dfd-135c-5f32-97bd-030268e7db8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL86865',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 148314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-27',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2016}
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL86865%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Saving data for BL86865: {'auction_closing_time': 1774883735.0, 'created_time': 1774521355.092971, 'last_price_update_time': 1774722875.477793}
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BL86865') HTTP/1.1" 204 0
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR74961%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Scrape type for TR74961: 0
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB52035%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Scrape type for CB52035: 0
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Scrape type for EN73396: 2
2026-03-28 18:34:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48bb1e7b-555c-54bf-be9e-76d810558871 with identifier: EN73396
2026-03-28 18:34:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48bb1e7b-555c-54bf-be9e-76d810558871 with scrape type 2
2026-03-28 18:34:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48bb1e7b-555c-54bf-be9e-76d810558871 with scrape type 2
2026-03-28 18:34:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48bb1e7b-555c-54bf-be9e-76d810558871, identifier: EN73396
2026-03-28 18:34:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48bb1e7b-555c-54bf-be9e-76d810558871 with identifier: EN73396
2026-03-28 18:34:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48bb1e7b-555c-54bf-be9e-76d810558871 with identifier: EN73396
2026-03-28 18:34:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48bb1e7b-555c-54bf-be9e-76d810558871 with identifier: EN73396 to the API
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-30T15:56:33Z',
 'fuel_type': 'diesel',
 'id': '48bb1e7b-555c-54bf-be9e-76d810558871',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN73396',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 127811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-29',
 'seller_name': None,
 'title': 'Smart fortwo 0.8 CDI Passion',
 'transmission': 'automatic',
 'trim': 'Passion',
 'year': 2011}
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN73396%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Saving data for EN73396: {'auction_closing_time': 1774886193.0, 'created_time': 1774521339.526447, 'last_price_update_time': 1774722875.962597}
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN73396') HTTP/1.1" 204 0
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR51449%27 HTTP/1.1" 200 None
2026-03-28 18:34:35 [auto1.de] INFO: Scrape type for SR51449: 0
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-28 18:34:35 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD56030%27 HTTP/1.1" 200 None
2026-03-28 18:34:36 [auto1.de] INFO: Scrape type for XD56030: 0
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR53906%27 HTTP/1.1" 200 None
2026-03-28 18:34:36 [auto1.de] INFO: Scrape type for BR53906: 0
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89680%27 HTTP/1.1" 200 None
2026-03-28 18:34:36 [auto1.de] INFO: Scrape type for CC89680: 0
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP12343%27 HTTP/1.1" 200 None
2026-03-28 18:34:36 [auto1.de] INFO: Scrape type for UP12343: 0
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ98191%27 HTTP/1.1" 200 None
2026-03-28 18:34:36 [auto1.de] INFO: Scrape type for FJ98191: 0
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF42870%27 HTTP/1.1" 200 None
2026-03-28 18:34:36 [auto1.de] INFO: Scrape type for YF42870: 0
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX02891%27 HTTP/1.1" 200 None
2026-03-28 18:34:36 [auto1.de] INFO: Scrape type for MX02891: 0
2026-03-28 18:34:36 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-28 18:34:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:37 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:37 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-28 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB55712%27 HTTP/1.1" 200 None
2026-03-28 18:34:37 [auto1.de] INFO: Scrape type for KB55712: 0
2026-03-28 18:34:37 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-28 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-28 18:34:37 [auto1.de] INFO: Scrape type for JN55022: 2
2026-03-28 18:34:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3340f424-39bb-5272-bff3-6733715f9dcb with identifier: JN55022
2026-03-28 18:34:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3340f424-39bb-5272-bff3-6733715f9dcb with scrape type 2
2026-03-28 18:34:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3340f424-39bb-5272-bff3-6733715f9dcb with scrape type 2
2026-03-28 18:34:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3340f424-39bb-5272-bff3-6733715f9dcb, identifier: JN55022
2026-03-28 18:34:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3340f424-39bb-5272-bff3-6733715f9dcb with identifier: JN55022
2026-03-28 18:34:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3340f424-39bb-5272-bff3-6733715f9dcb with identifier: JN55022
2026-03-28 18:34:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3340f424-39bb-5272-bff3-6733715f9dcb with identifier: JN55022 to the API
2026-03-28 18:34:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:20:37Z',
 'fuel_type': 'diesel',
 'id': '3340f424-39bb-5272-bff3-6733715f9dcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN55022',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 205598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-31',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2017}
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN55022%27 HTTP/1.1" 200 None
2026-03-28 18:34:38 [auto1.de] INFO: Saving data for JN55022: {'auction_closing_time': 1774884037.0, 'created_time': 1774521450.307439, 'last_price_update_time': 1774722878.341803}
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN55022') HTTP/1.1" 204 0
2026-03-28 18:34:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:38 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG10067%27 HTTP/1.1" 200 None
2026-03-28 18:34:38 [auto1.de] INFO: Scrape type for SG10067: 0
2026-03-28 18:34:38 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-28 18:34:38 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-28 18:34:38 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-28 18:34:38 [auto1.de] INFO: Scrape type for EM77424: 2
2026-03-28 18:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a506948-05d1-5a08-bf36-eba8c20d31df with identifier: EM77424
2026-03-28 18:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a506948-05d1-5a08-bf36-eba8c20d31df with scrape type 2
2026-03-28 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a506948-05d1-5a08-bf36-eba8c20d31df with scrape type 2
2026-03-28 18:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a506948-05d1-5a08-bf36-eba8c20d31df, identifier: EM77424
2026-03-28 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a506948-05d1-5a08-bf36-eba8c20d31df with identifier: EM77424
2026-03-28 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a506948-05d1-5a08-bf36-eba8c20d31df with identifier: EM77424
2026-03-28 18:34:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a506948-05d1-5a08-bf36-eba8c20d31df with identifier: EM77424 to the API
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:07:21Z',
 'fuel_type': 'petrol',
 'id': '8a506948-05d1-5a08-bf36-eba8c20d31df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM77424',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 50980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM77424%27 HTTP/1.1" 200 None
2026-03-28 18:34:38 [auto1.de] INFO: Saving data for EM77424: {'auction_closing_time': 1774883241.0, 'created_time': 1774549867.436668, 'last_price_update_time': 1774722878.873815}
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM77424') HTTP/1.1" 204 0
2026-03-28 18:34:38 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-28 18:34:38 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-28 18:34:38 [auto1.de] INFO: Scrape type for CV73879: 2
2026-03-28 18:34:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with identifier: CV73879
2026-03-28 18:34:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with scrape type 2
2026-03-28 18:34:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with scrape type 2
2026-03-28 18:34:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3b4fbfb-1b1c-55b1-99ca-614b77f75375, identifier: CV73879
2026-03-28 18:34:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with identifier: CV73879
2026-03-28 18:34:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with identifier: CV73879
2026-03-28 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3b4fbfb-1b1c-55b1-99ca-614b77f75375 with identifier: CV73879 to the API
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:30:27Z',
 'fuel_type': 'diesel',
 'id': 'e3b4fbfb-1b1c-55b1-99ca-614b77f75375',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV73879',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 197614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 111 CDI extralang Tourer Edition',
 'transmission': 'manual',
 'trim': 'extralang Tourer Edition',
 'year': 2017}
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV73879%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Saving data for CV73879: {'auction_closing_time': 1774884627.0, 'created_time': 1774521331.716074, 'last_price_update_time': 1774722879.303504}
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV73879') HTTP/1.1" 204 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG24182%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for DG24182: 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM25348%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for PM25348: 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH69099%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for CH69099: 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17910%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for WL17910: 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS03842%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for HS03842: 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS26605%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for BS26605: 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ67594%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for TJ67594: 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for JS09258: 2
2026-03-28 18:34:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d4a52d-59b9-5655-8331-910348559829 with identifier: JS09258
2026-03-28 18:34:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28d4a52d-59b9-5655-8331-910348559829 with scrape type 2
2026-03-28 18:34:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28d4a52d-59b9-5655-8331-910348559829 with scrape type 2
2026-03-28 18:34:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28d4a52d-59b9-5655-8331-910348559829, identifier: JS09258
2026-03-28 18:34:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28d4a52d-59b9-5655-8331-910348559829 with identifier: JS09258
2026-03-28 18:34:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28d4a52d-59b9-5655-8331-910348559829 with identifier: JS09258
2026-03-28 18:34:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28d4a52d-59b9-5655-8331-910348559829 with identifier: JS09258 to the API
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:38:38Z',
 'fuel_type': 'diesel',
 'id': '28d4a52d-59b9-5655-8331-910348559829',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JS09258',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 159105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Scout 4x4',
 'transmission': 'automatic',
 'trim': 'Scout 4x4',
 'year': 2016}
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS09258%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Saving data for JS09258: {'auction_closing_time': 1774885118.0, 'created_time': 1774118556.004386, 'last_price_update_time': 1774722879.856425}
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JS09258') HTTP/1.1" 204 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL45864%27 HTTP/1.1" 200 None
2026-03-28 18:34:39 [auto1.de] INFO: Scrape type for TL45864: 0
2026-03-28 18:34:39 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-28 18:34:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD60404%27 HTTP/1.1" 200 None
2026-03-28 18:34:40 [auto1.de] INFO: Scrape type for GD60404: 0
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-28 18:34:40 [auto1.de] INFO: Scrape type for VT43931: 2
2026-03-28 18:34:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0262f5e3-9373-5b5a-92fc-83d43777773a with identifier: VT43931
2026-03-28 18:34:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0262f5e3-9373-5b5a-92fc-83d43777773a with scrape type 2
2026-03-28 18:34:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0262f5e3-9373-5b5a-92fc-83d43777773a with scrape type 2
2026-03-28 18:34:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0262f5e3-9373-5b5a-92fc-83d43777773a, identifier: VT43931
2026-03-28 18:34:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0262f5e3-9373-5b5a-92fc-83d43777773a with identifier: VT43931
2026-03-28 18:34:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0262f5e3-9373-5b5a-92fc-83d43777773a with identifier: VT43931
2026-03-28 18:34:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0262f5e3-9373-5b5a-92fc-83d43777773a with identifier: VT43931 to the API
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-30T15:35:10Z',
 'fuel_type': 'diesel',
 'id': '0262f5e3-9373-5b5a-92fc-83d43777773a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT43931',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 47470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-25',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT43931%27 HTTP/1.1" 200 None
2026-03-28 18:34:40 [auto1.de] INFO: Saving data for VT43931: {'auction_closing_time': 1774884910.0, 'created_time': 1774521839.610755, 'last_price_update_time': 1774722880.430256}
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VT43931') HTTP/1.1" 204 0
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF09149%27 HTTP/1.1" 200 None
2026-03-28 18:34:40 [auto1.de] INFO: Scrape type for CF09149: 0
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV28684%27 HTTP/1.1" 200 None
2026-03-28 18:34:40 [auto1.de] INFO: Scrape type for GV28684: 0
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS13064%27 HTTP/1.1" 200 None
2026-03-28 18:34:40 [auto1.de] INFO: Scrape type for YS13064: 0
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU47356%27 HTTP/1.1" 200 None
2026-03-28 18:34:40 [auto1.de] INFO: Scrape type for MU47356: 0
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-28 18:34:40 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-28 18:34:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:41 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:41 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-28 18:34:41 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-28 18:34:41 [auto1.de] INFO: Scrape type for VJ59637: 2
2026-03-28 18:34:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1593f713-0c60-5a04-bfeb-ece73a5967f1 with identifier: VJ59637
2026-03-28 18:34:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1593f713-0c60-5a04-bfeb-ece73a5967f1 with scrape type 2
2026-03-28 18:34:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1593f713-0c60-5a04-bfeb-ece73a5967f1 with scrape type 2
2026-03-28 18:34:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1593f713-0c60-5a04-bfeb-ece73a5967f1, identifier: VJ59637
2026-03-28 18:34:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1593f713-0c60-5a04-bfeb-ece73a5967f1 with identifier: VJ59637
2026-03-28 18:34:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1593f713-0c60-5a04-bfeb-ece73a5967f1 with identifier: VJ59637
2026-03-28 18:34:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1593f713-0c60-5a04-bfeb-ece73a5967f1 with identifier: VJ59637 to the API
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:10:49Z',
 'fuel_type': 'petrol',
 'id': '1593f713-0c60-5a04-bfeb-ece73a5967f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ59637',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 183003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-02',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up!',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2012}
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ59637%27 HTTP/1.1" 200 None
2026-03-28 18:34:41 [auto1.de] INFO: Saving data for VJ59637: {'auction_closing_time': 1774883449.0, 'created_time': 1774118752.266114, 'last_price_update_time': 1774722881.880706}
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ59637') HTTP/1.1" 204 0
2026-03-28 18:34:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:41 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-28 18:34:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU53643%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for UU53643: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL16221%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for VL16221: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ56060%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for SZ56060: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH95980%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for AH95980: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF02392%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for MF02392: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX28269%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for NX28269: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH44526%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for DH44526: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD00860%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for YD00860: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC60688%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for PC60688: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM62598%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for XM62598: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG28857%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for MG28857: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR06917%27 HTTP/1.1" 200 None
2026-03-28 18:34:42 [auto1.de] INFO: Scrape type for LR06917: 0
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-28 18:34:42 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-28 18:34:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:43 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: HJ77178
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE57150%27 HTTP/1.1" 200 None
2026-03-28 18:34:43 [auto1.de] INFO: Scrape type for UE57150: 0
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-28 18:34:43 [auto1.de] INFO: Scrape type for JX01740: 2
2026-03-28 18:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b909f28-33f7-5267-94b7-d835ef702a1b with identifier: JX01740
2026-03-28 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b909f28-33f7-5267-94b7-d835ef702a1b with scrape type 2
2026-03-28 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b909f28-33f7-5267-94b7-d835ef702a1b with scrape type 2
2026-03-28 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b909f28-33f7-5267-94b7-d835ef702a1b, identifier: JX01740
2026-03-28 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b909f28-33f7-5267-94b7-d835ef702a1b with identifier: JX01740
2026-03-28 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b909f28-33f7-5267-94b7-d835ef702a1b with identifier: JX01740
2026-03-28 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b909f28-33f7-5267-94b7-d835ef702a1b with identifier: JX01740 to the API
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:22Z',
 'fuel_type': 'diesel',
 'id': '6b909f28-33f7-5267-94b7-d835ef702a1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX01740',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 151112,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-04',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2017}
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX01740%27 HTTP/1.1" 200 None
2026-03-28 18:34:43 [auto1.de] INFO: Saving data for JX01740: {'auction_closing_time': 1774884442.0, 'created_time': 1773774802.423346, 'last_price_update_time': 1774722883.55919}
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX01740') HTTP/1.1" 204 0
2026-03-28 18:34:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL79730%27 HTTP/1.1" 200 None
2026-03-28 18:34:43 [auto1.de] INFO: Scrape type for VL79730: 0
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY50821%27 HTTP/1.1" 200 None
2026-03-28 18:34:43 [auto1.de] INFO: Scrape type for CY50821: 0
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD98070%27 HTTP/1.1" 200 None
2026-03-28 18:34:43 [auto1.de] INFO: Scrape type for BD98070: 0
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-28 18:34:43 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-28 18:34:43 [auto1.de] INFO: Scrape type for PH00076: 2
2026-03-28 18:34:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with identifier: PH00076
2026-03-28 18:34:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with scrape type 2
2026-03-28 18:34:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with scrape type 2
2026-03-28 18:34:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2, identifier: PH00076
2026-03-28 18:34:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with identifier: PH00076
2026-03-28 18:34:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with identifier: PH00076
2026-03-28 18:34:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2 with identifier: PH00076 to the API
2026-03-28 18:34:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:45:09Z',
 'fuel_type': 'diesel',
 'id': '01bd5e02-4f41-5f96-92ae-4c4ac2aa60f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH00076',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 224743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-08',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2015}
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00076%27 HTTP/1.1" 200 None
2026-03-28 18:34:44 [auto1.de] INFO: Saving data for PH00076: {'auction_closing_time': 1774885509.0, 'created_time': 1773830285.249546, 'last_price_update_time': 1774722884.216326}
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH00076') HTTP/1.1" 204 0
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-28 18:34:44 [auto1.de] INFO: Scrape type for AD50420: 2
2026-03-28 18:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9035798-f94c-545b-839c-746f45769d3c with identifier: AD50420
2026-03-28 18:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9035798-f94c-545b-839c-746f45769d3c with scrape type 2
2026-03-28 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9035798-f94c-545b-839c-746f45769d3c with scrape type 2
2026-03-28 18:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9035798-f94c-545b-839c-746f45769d3c, identifier: AD50420
2026-03-28 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9035798-f94c-545b-839c-746f45769d3c with identifier: AD50420
2026-03-28 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9035798-f94c-545b-839c-746f45769d3c with identifier: AD50420
2026-03-28 18:34:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9035798-f94c-545b-839c-746f45769d3c with identifier: AD50420 to the API
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:15:46Z',
 'fuel_type': 'petrol',
 'id': 'a9035798-f94c-545b-839c-746f45769d3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD50420',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 163541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD50420%27 HTTP/1.1" 200 None
2026-03-28 18:34:44 [auto1.de] INFO: Saving data for AD50420: {'auction_closing_time': 1774883746.0, 'created_time': 1774521667.533898, 'last_price_update_time': 1774722884.668806}
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD50420') HTTP/1.1" 204 0
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH10138%27 HTTP/1.1" 200 None
2026-03-28 18:34:44 [auto1.de] INFO: Scrape type for UH10138: 0
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-28 18:34:44 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-28 18:34:44 [auto1.de] INFO: Scrape type for LN93862: 2
2026-03-28 18:34:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be9b86c0-6aad-5de7-bebe-e9a32193b367 with identifier: LN93862
2026-03-28 18:34:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be9b86c0-6aad-5de7-bebe-e9a32193b367 with scrape type 2
2026-03-28 18:34:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be9b86c0-6aad-5de7-bebe-e9a32193b367 with scrape type 2
2026-03-28 18:34:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be9b86c0-6aad-5de7-bebe-e9a32193b367, identifier: LN93862
2026-03-28 18:34:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be9b86c0-6aad-5de7-bebe-e9a32193b367 with identifier: LN93862
2026-03-28 18:34:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be9b86c0-6aad-5de7-bebe-e9a32193b367 with identifier: LN93862
2026-03-28 18:34:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be9b86c0-6aad-5de7-bebe-e9a32193b367 with identifier: LN93862 to the API
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:38:05Z',
 'fuel_type': 'petrol',
 'id': 'be9b86c0-6aad-5de7-bebe-e9a32193b367',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN93862',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 124052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-05',
 'seller_name': None,
 'title': 'BMW 1er 118i Edition M Sport Shadow',
 'transmission': 'automatic',
 'trim': 'Edition M Sport Shadow',
 'year': 2018}
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN93862%27 HTTP/1.1" 200 None
2026-03-28 18:34:45 [auto1.de] INFO: Saving data for LN93862: {'auction_closing_time': 1774885085.0, 'created_time': 1774522028.738425, 'last_price_update_time': 1774722885.194544}
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN93862') HTTP/1.1" 204 0
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF91540%27 HTTP/1.1" 200 None
2026-03-28 18:34:45 [auto1.de] INFO: Scrape type for ZF91540: 0
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE85774%27 HTTP/1.1" 200 None
2026-03-28 18:34:45 [auto1.de] INFO: Scrape type for DE85774: 0
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET59047%27 HTTP/1.1" 200 None
2026-03-28 18:34:45 [auto1.de] INFO: Scrape type for ET59047: 0
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR76788%27 HTTP/1.1" 200 None
2026-03-28 18:34:45 [auto1.de] INFO: Scrape type for BR76788: 0
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL76152%27 HTTP/1.1" 200 None
2026-03-28 18:34:45 [auto1.de] INFO: Scrape type for ZL76152: 0
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA85998%27 HTTP/1.1" 200 None
2026-03-28 18:34:45 [auto1.de] INFO: Scrape type for PA85998: 0
2026-03-28 18:34:45 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-28 18:34:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:46 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:46 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-28 18:34:46 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE32009%27 HTTP/1.1" 200 None
2026-03-28 18:34:46 [auto1.de] INFO: Scrape type for SE32009: 0
2026-03-28 18:34:46 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-28 18:34:46 [auto1.de] INFO: Scrape type for JH64089: 2
2026-03-28 18:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1add5594-0ecd-56d2-956f-b1d0287220e9 with identifier: JH64089
2026-03-28 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1add5594-0ecd-56d2-956f-b1d0287220e9 with scrape type 2
2026-03-28 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1add5594-0ecd-56d2-956f-b1d0287220e9 with scrape type 2
2026-03-28 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1add5594-0ecd-56d2-956f-b1d0287220e9, identifier: JH64089
2026-03-28 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1add5594-0ecd-56d2-956f-b1d0287220e9 with identifier: JH64089
2026-03-28 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1add5594-0ecd-56d2-956f-b1d0287220e9 with identifier: JH64089
2026-03-28 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1add5594-0ecd-56d2-956f-b1d0287220e9 with identifier: JH64089 to the API
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:36:48Z',
 'fuel_type': 'diesel',
 'id': '1add5594-0ecd-56d2-956f-b1d0287220e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH64089',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 125910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH64089%27 HTTP/1.1" 200 None
2026-03-28 18:34:46 [auto1.de] INFO: Saving data for JH64089: {'auction_closing_time': 1774885008.0, 'created_time': 1773467447.264691, 'last_price_update_time': 1774722886.605724}
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH64089') HTTP/1.1" 204 0
2026-03-28 18:34:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:46 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE16908%27 HTTP/1.1" 200 None
2026-03-28 18:34:46 [auto1.de] INFO: Scrape type for BE16908: 0
2026-03-28 18:34:46 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-28 18:34:46 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-28 18:34:46 [auto1.de] INFO: Scrape type for AP07103: 2
2026-03-28 18:34:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 906a92da-1e98-569a-97b9-7425e6b624e0 with identifier: AP07103
2026-03-28 18:34:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 906a92da-1e98-569a-97b9-7425e6b624e0 with scrape type 2
2026-03-28 18:34:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 906a92da-1e98-569a-97b9-7425e6b624e0 with scrape type 2
2026-03-28 18:34:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 906a92da-1e98-569a-97b9-7425e6b624e0, identifier: AP07103
2026-03-28 18:34:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 906a92da-1e98-569a-97b9-7425e6b624e0 with identifier: AP07103
2026-03-28 18:34:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 906a92da-1e98-569a-97b9-7425e6b624e0 with identifier: AP07103
2026-03-28 18:34:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 906a92da-1e98-569a-97b9-7425e6b624e0 with identifier: AP07103 to the API
2026-03-28 18:34:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:02Z',
 'fuel_type': 'diesel',
 'id': '906a92da-1e98-569a-97b9-7425e6b624e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP07103',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 278782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-07',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2013}
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP07103%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Saving data for AP07103: {'auction_closing_time': 1774885922.0, 'created_time': 1774522050.354785, 'last_price_update_time': 1774722887.166938}
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP07103') HTTP/1.1" 204 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT76935%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for VT76935: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY26864%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for GY26864: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX47183%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for MX47183: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM37202%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for ZM37202: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT61440%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for HT61440: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF23160%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for PF23160: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for CS78773: 2
2026-03-28 18:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77506400-ac21-5c1a-ae33-3ef21331301e with identifier: CS78773
2026-03-28 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77506400-ac21-5c1a-ae33-3ef21331301e with scrape type 2
2026-03-28 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77506400-ac21-5c1a-ae33-3ef21331301e with scrape type 2
2026-03-28 18:34:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77506400-ac21-5c1a-ae33-3ef21331301e, identifier: CS78773
2026-03-28 18:34:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77506400-ac21-5c1a-ae33-3ef21331301e with identifier: CS78773
2026-03-28 18:34:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77506400-ac21-5c1a-ae33-3ef21331301e with identifier: CS78773
2026-03-28 18:34:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77506400-ac21-5c1a-ae33-3ef21331301e with identifier: CS78773 to the API
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:15Z',
 'fuel_type': 'diesel',
 'id': '77506400-ac21-5c1a-ae33-3ef21331301e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS78773',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 204323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi XTR',
 'transmission': 'manual',
 'trim': 'XTR',
 'year': 2009}
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS78773%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Saving data for CS78773: {'auction_closing_time': 1774885455.0, 'created_time': 1774521332.886892, 'last_price_update_time': 1774722887.69818}
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS78773') HTTP/1.1" 204 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW48203%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for UW48203: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY15812%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for NY15812: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00325%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for YC00325: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB92999%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for EB92999: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY23363%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for EY23363: 0
2026-03-28 18:34:47 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-28 18:34:47 [auto1.de] INFO: Scrape type for YJ27680: 2
2026-03-28 18:34:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-03-28 18:34:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with scrape type 2
2026-03-28 18:34:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with scrape type 2
2026-03-28 18:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e75d858-f9bb-5b21-b204-2ad75b7e9729, identifier: YJ27680
2026-03-28 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-03-28 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680
2026-03-28 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e75d858-f9bb-5b21-b204-2ad75b7e9729 with identifier: YJ27680 to the API
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:50:54Z',
 'fuel_type': 'petrol',
 'id': '5e75d858-f9bb-5b21-b204-2ad75b7e9729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ27680',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 100742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'Peugeot Partner 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ27680%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Saving data for YJ27680: {'auction_closing_time': 1774885854.0, 'created_time': 1774636315.867659, 'last_price_update_time': 1774722888.321442}
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ27680') HTTP/1.1" 204 0
2026-03-28 18:34:48 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53261%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Scrape type for KL53261: 0
2026-03-28 18:34:48 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV21869%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Scrape type for HV21869: 0
2026-03-28 18:34:48 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Scrape type for LU56386: 2
2026-03-28 18:34:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e52eee6-958a-5cd9-b543-fec0895527fc with identifier: LU56386
2026-03-28 18:34:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e52eee6-958a-5cd9-b543-fec0895527fc with scrape type 2
2026-03-28 18:34:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e52eee6-958a-5cd9-b543-fec0895527fc with scrape type 2
2026-03-28 18:34:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e52eee6-958a-5cd9-b543-fec0895527fc, identifier: LU56386
2026-03-28 18:34:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e52eee6-958a-5cd9-b543-fec0895527fc with identifier: LU56386
2026-03-28 18:34:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e52eee6-958a-5cd9-b543-fec0895527fc with identifier: LU56386
2026-03-28 18:34:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e52eee6-958a-5cd9-b543-fec0895527fc with identifier: LU56386 to the API
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:01:24Z',
 'fuel_type': 'diesel',
 'id': '2e52eee6-958a-5cd9-b543-fec0895527fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU56386',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 154887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-11',
 'seller_name': None,
 'title': 'BMW X2 xDrive 20d M Sport X',
 'transmission': 'automatic',
 'trim': 'M Sport X',
 'year': 2019}
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU56386%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Saving data for LU56386: {'auction_closing_time': 1774882884.0, 'created_time': 1773303136.929144, 'last_price_update_time': 1774722888.921444}
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU56386') HTTP/1.1" 204 0
2026-03-28 18:34:48 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE58420%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Scrape type for TE58420: 0
2026-03-28 18:34:48 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC77518%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Scrape type for LC77518: 0
2026-03-28 18:34:48 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG63962%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Scrape type for PG63962: 0
2026-03-28 18:34:48 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK06356%27 HTTP/1.1" 200 None
2026-03-28 18:34:48 [auto1.de] INFO: Scrape type for WK06356: 0
2026-03-28 18:34:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:49 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:49 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-28 18:34:49 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU69800%27 HTTP/1.1" 200 None
2026-03-28 18:34:50 [auto1.de] INFO: Scrape type for DU69800: 0
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH07700%27 HTTP/1.1" 200 None
2026-03-28 18:34:50 [auto1.de] INFO: Scrape type for AH07700: 0
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY87564%27 HTTP/1.1" 200 None
2026-03-28 18:34:50 [auto1.de] INFO: Scrape type for WY87564: 0
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65181%27 HTTP/1.1" 200 None
2026-03-28 18:34:50 [auto1.de] INFO: Scrape type for YG65181: 0
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-28 18:34:50 [auto1.de] INFO: Scrape type for AF84640: 2
2026-03-28 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b7e388-c022-57dc-b851-aa7af4031680 with identifier: AF84640
2026-03-28 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b7e388-c022-57dc-b851-aa7af4031680 with scrape type 2
2026-03-28 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9b7e388-c022-57dc-b851-aa7af4031680 with scrape type 2
2026-03-28 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9b7e388-c022-57dc-b851-aa7af4031680, identifier: AF84640
2026-03-28 18:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9b7e388-c022-57dc-b851-aa7af4031680 with identifier: AF84640
2026-03-28 18:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9b7e388-c022-57dc-b851-aa7af4031680 with identifier: AF84640
2026-03-28 18:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9b7e388-c022-57dc-b851-aa7af4031680 with identifier: AF84640 to the API
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:13:44Z',
 'fuel_type': 'diesel',
 'id': 'f9b7e388-c022-57dc-b851-aa7af4031680',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF84640',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 42309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2022}
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF84640%27 HTTP/1.1" 200 None
2026-03-28 18:34:50 [auto1.de] INFO: Saving data for AF84640: {'auction_closing_time': 1774883624.0, 'created_time': 1774118799.64419, 'last_price_update_time': 1774722890.494973}
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF84640') HTTP/1.1" 204 0
2026-03-28 18:34:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW18754%27 HTTP/1.1" 200 None
2026-03-28 18:34:50 [auto1.de] INFO: Scrape type for BW18754: 0
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-28 18:34:50 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-28 18:34:50 [auto1.de] INFO: Scrape type for GP94559: 2
2026-03-28 18:34:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb3fb60-321d-57ce-ae03-01438262cbc3 with identifier: GP94559
2026-03-28 18:34:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb3fb60-321d-57ce-ae03-01438262cbc3 with scrape type 2
2026-03-28 18:34:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb3fb60-321d-57ce-ae03-01438262cbc3 with scrape type 2
2026-03-28 18:34:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efb3fb60-321d-57ce-ae03-01438262cbc3, identifier: GP94559
2026-03-28 18:34:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efb3fb60-321d-57ce-ae03-01438262cbc3 with identifier: GP94559
2026-03-28 18:34:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efb3fb60-321d-57ce-ae03-01438262cbc3 with identifier: GP94559
2026-03-28 18:34:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efb3fb60-321d-57ce-ae03-01438262cbc3 with identifier: GP94559 to the API
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:22:19Z',
 'fuel_type': 'petrol',
 'id': 'efb3fb60-321d-57ce-ae03-01438262cbc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP94559',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 39064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-22',
 'seller_name': None,
 'title': 'Volkswagen Beetle 2.0 TSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2013}
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP94559%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Saving data for GP94559: {'auction_closing_time': 1774884139.0, 'created_time': 1773426823.154575, 'last_price_update_time': 1774722891.051796}
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP94559') HTTP/1.1" 204 0
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Scrape type for GZ21000: 2
2026-03-28 18:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42b317e8-d76b-512c-94dd-9baafe31877b with identifier: GZ21000
2026-03-28 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42b317e8-d76b-512c-94dd-9baafe31877b with scrape type 2
2026-03-28 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42b317e8-d76b-512c-94dd-9baafe31877b with scrape type 2
2026-03-28 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42b317e8-d76b-512c-94dd-9baafe31877b, identifier: GZ21000
2026-03-28 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42b317e8-d76b-512c-94dd-9baafe31877b with identifier: GZ21000
2026-03-28 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42b317e8-d76b-512c-94dd-9baafe31877b with identifier: GZ21000
2026-03-28 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42b317e8-d76b-512c-94dd-9baafe31877b with identifier: GZ21000 to the API
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:05Z',
 'fuel_type': 'petrol',
 'id': '42b317e8-d76b-512c-94dd-9baafe31877b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ21000',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 126461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-28',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ21000%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Saving data for GZ21000: {'auction_closing_time': 1774882985.0, 'created_time': 1774636361.765101, 'last_price_update_time': 1774722891.497015}
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ21000') HTTP/1.1" 204 0
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM28187%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Scrape type for YM28187: 0
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14818%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Scrape type for VX14818: 0
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP02035%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Scrape type for WP02035: 0
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE75344%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Scrape type for ZE75344: 0
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY81223%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Scrape type for AY81223: 0
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA26329%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Scrape type for GA26329: 0
2026-03-28 18:34:51 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-28 18:34:51 [auto1.de] INFO: Scrape type for FW15462: 2
2026-03-28 18:34:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83671081-7c85-55e2-9e1a-c19b2d67a221 with identifier: FW15462
2026-03-28 18:34:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83671081-7c85-55e2-9e1a-c19b2d67a221 with scrape type 2
2026-03-28 18:34:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83671081-7c85-55e2-9e1a-c19b2d67a221 with scrape type 2
2026-03-28 18:34:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83671081-7c85-55e2-9e1a-c19b2d67a221, identifier: FW15462
2026-03-28 18:34:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83671081-7c85-55e2-9e1a-c19b2d67a221 with identifier: FW15462
2026-03-28 18:34:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83671081-7c85-55e2-9e1a-c19b2d67a221 with identifier: FW15462
2026-03-28 18:34:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83671081-7c85-55e2-9e1a-c19b2d67a221 with identifier: FW15462 to the API
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:14:57Z',
 'fuel_type': 'diesel',
 'id': '83671081-7c85-55e2-9e1a-c19b2d67a221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW15462',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 261456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-02',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2012}
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW15462%27 HTTP/1.1" 200 None
2026-03-28 18:34:52 [auto1.de] INFO: Saving data for FW15462: {'auction_closing_time': 1774883697.0, 'created_time': 1774118597.909569, 'last_price_update_time': 1774722892.032665}
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW15462') HTTP/1.1" 204 0
2026-03-28 18:34:52 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-28 18:34:52 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-28 18:34:52 [auto1.de] INFO: Scrape type for DW82351: 2
2026-03-28 18:34:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with identifier: DW82351
2026-03-28 18:34:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with scrape type 2
2026-03-28 18:34:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with scrape type 2
2026-03-28 18:34:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0, identifier: DW82351
2026-03-28 18:34:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with identifier: DW82351
2026-03-28 18:34:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with identifier: DW82351
2026-03-28 18:34:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0 with identifier: DW82351 to the API
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:31:04Z',
 'fuel_type': 'hybrid',
 'id': '3e8d1802-ed5a-59cb-b01b-f34ee5a9b8a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW82351',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 31654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW82351%27 HTTP/1.1" 200 None
2026-03-28 18:34:52 [auto1.de] INFO: Saving data for DW82351: {'auction_closing_time': 1774884664.0, 'created_time': 1774549860.863351, 'last_price_update_time': 1774722892.570666}
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW82351') HTTP/1.1" 204 0
2026-03-28 18:34:52 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-28 18:34:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:34:53 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 5998 | hits on page: 40
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH97983%27 HTTP/1.1" 200 None
2026-03-28 18:34:53 [auto1.de] INFO: Scrape type for AH97983: 0
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP64585%27 HTTP/1.1" 200 None
2026-03-28 18:34:53 [auto1.de] INFO: Scrape type for NP64585: 0
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK16564%27 HTTP/1.1" 200 None
2026-03-28 18:34:53 [auto1.de] INFO: Scrape type for ZK16564: 0
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW33443%27 HTTP/1.1" 200 None
2026-03-28 18:34:53 [auto1.de] INFO: Scrape type for RW33443: 0
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK41294%27 HTTP/1.1" 200 None
2026-03-28 18:34:53 [auto1.de] INFO: Scrape type for AK41294: 0
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ25575%27 HTTP/1.1" 200 None
2026-03-28 18:34:53 [auto1.de] INFO: Scrape type for EJ25575: 0
2026-03-28 18:34:53 [auto1.de] INFO: Found listing with ID: VT05460
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT05460%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for VT05460: 0
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU04688%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for ZU04688: 0
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE86723%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for XE86723: 0
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG01443%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for EG01443: 0
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX31727%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for ZX31727: 0
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF09730%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for BF09730: 0
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for JA06342: 2
2026-03-28 18:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fb65382-5a5d-5408-982f-47aaf084ee68 with identifier: JA06342
2026-03-28 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fb65382-5a5d-5408-982f-47aaf084ee68 with scrape type 2
2026-03-28 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fb65382-5a5d-5408-982f-47aaf084ee68 with scrape type 2
2026-03-28 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fb65382-5a5d-5408-982f-47aaf084ee68, identifier: JA06342
2026-03-28 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fb65382-5a5d-5408-982f-47aaf084ee68 with identifier: JA06342
2026-03-28 18:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fb65382-5a5d-5408-982f-47aaf084ee68 with identifier: JA06342
2026-03-28 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fb65382-5a5d-5408-982f-47aaf084ee68 with identifier: JA06342 to the API
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:32Z',
 'fuel_type': 'petrol',
 'id': '9fb65382-5a5d-5408-982f-47aaf084ee68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA06342',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 20755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-05',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2024}
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA06342%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Saving data for JA06342: {'auction_closing_time': 1774885172.0, 'created_time': 1773306904.182167, 'last_price_update_time': 1774722894.543316}
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA06342') HTTP/1.1" 204 0
2026-03-28 18:34:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB64458%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for NB64458: 0
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR91039%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for PR91039: 0
2026-03-28 18:34:54 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-28 18:34:54 [auto1.de] INFO: Scrape type for BV47016: 2
2026-03-28 18:34:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67dac53d-45c6-5d07-98d4-bbc43186c703 with identifier: BV47016
2026-03-28 18:34:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67dac53d-45c6-5d07-98d4-bbc43186c703 with scrape type 2
2026-03-28 18:34:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67dac53d-45c6-5d07-98d4-bbc43186c703 with scrape type 2
2026-03-28 18:34:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67dac53d-45c6-5d07-98d4-bbc43186c703, identifier: BV47016
2026-03-28 18:34:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67dac53d-45c6-5d07-98d4-bbc43186c703 with identifier: BV47016
2026-03-28 18:34:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67dac53d-45c6-5d07-98d4-bbc43186c703 with identifier: BV47016
2026-03-28 18:34:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67dac53d-45c6-5d07-98d4-bbc43186c703 with identifier: BV47016 to the API
2026-03-28 18:34:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:06:07Z',
 'fuel_type': 'petrol',
 'id': '67dac53d-45c6-5d07-98d4-bbc43186c703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV47016',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 57688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-28',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Black Edition',
 'transmission': 'automatic',
 'trim': 'Black Edition',
 'year': 2021}
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV47016%27 HTTP/1.1" 200 None
2026-03-28 18:34:55 [auto1.de] INFO: Saving data for BV47016: {'auction_closing_time': 1774883167.0, 'created_time': 1773469072.383074, 'last_price_update_time': 1774722895.115826}
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV47016') HTTP/1.1" 204 0
2026-03-28 18:34:55 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY22077%27 HTTP/1.1" 200 None
2026-03-28 18:34:55 [auto1.de] INFO: Scrape type for ZY22077: 0
2026-03-28 18:34:55 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-28 18:34:55 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK53222%27 HTTP/1.1" 200 None
2026-03-28 18:34:55 [auto1.de] INFO: Scrape type for GK53222: 0
2026-03-28 18:34:55 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-28 18:34:55 [auto1.de] INFO: Scrape type for YC50370: 2
2026-03-28 18:34:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with identifier: YC50370
2026-03-28 18:34:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with scrape type 2
2026-03-28 18:34:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with scrape type 2
2026-03-28 18:34:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c37afce-6f2f-5a08-a48b-40582aeccdc7, identifier: YC50370
2026-03-28 18:34:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with identifier: YC50370
2026-03-28 18:34:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with identifier: YC50370
2026-03-28 18:34:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c37afce-6f2f-5a08-a48b-40582aeccdc7 with identifier: YC50370 to the API
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:34:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-30T15:59:32Z',
 'fuel_type': 'diesel',
 'id': '8c37afce-6f2f-5a08-a48b-40582aeccdc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC50370',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 210860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-19',
 'seller_name': None,
 'title': 'Audi A8 3.0 TDI Mild-Hybrid L 50 quattro',
 'transmission': 'automatic',
 'trim': 'L 50 quattro',
 'year': 2020}
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC50370%27 HTTP/1.1" 200 None
2026-03-28 18:34:55 [auto1.de] INFO: Saving data for YC50370: {'auction_closing_time': 1774886372.0, 'created_time': 1774521336.392803, 'last_price_update_time': 1774722895.569312}
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC50370') HTTP/1.1" 204 0
2026-03-28 18:34:55 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-28 18:34:55 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:34:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-28 18:34:55 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-28 18:34:55 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-28 18:35:07 [scrapy.extensions.logstats] INFO: Crawled 129 pages (at 16 pages/min), scraped 306 items (at 58 items/min)
2026-03-28 18:35:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-28 18:35:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:26 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT24863%27 HTTP/1.1" 200 None
2026-03-28 18:35:26 [auto1.de] INFO: Scrape type for HT24863: 0
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ26894%27 HTTP/1.1" 200 None
2026-03-28 18:35:26 [auto1.de] INFO: Scrape type for MZ26894: 0
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC04315%27 HTTP/1.1" 200 None
2026-03-28 18:35:26 [auto1.de] INFO: Scrape type for RC04315: 0
2026-03-28 18:35:26 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-28 18:35:26 [auto1.de] INFO: Scrape type for XF59932: 2
2026-03-28 18:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708b719d-b1cb-56f7-8021-102749ddb47e with identifier: XF59932
2026-03-28 18:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708b719d-b1cb-56f7-8021-102749ddb47e with scrape type 2
2026-03-28 18:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 708b719d-b1cb-56f7-8021-102749ddb47e with scrape type 2
2026-03-28 18:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 708b719d-b1cb-56f7-8021-102749ddb47e, identifier: XF59932
2026-03-28 18:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 708b719d-b1cb-56f7-8021-102749ddb47e with identifier: XF59932
2026-03-28 18:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 708b719d-b1cb-56f7-8021-102749ddb47e with identifier: XF59932
2026-03-28 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 708b719d-b1cb-56f7-8021-102749ddb47e with identifier: XF59932 to the API
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:33Z',
 'fuel_type': 'diesel',
 'id': '708b719d-b1cb-56f7-8021-102749ddb47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF59932',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 318443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF59932%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Saving data for XF59932: {'auction_closing_time': 1774883193.0, 'created_time': 1774521955.245323, 'last_price_update_time': 1774722927.263016}
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF59932') HTTP/1.1" 204 0
2026-03-28 18:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS21978%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for XS21978: 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG70236%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for JG70236: 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP03676%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for CP03676: 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14183%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for BS14183: 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY07264%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for CY07264: 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL51955%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for FL51955: 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM68518%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for CM68518: 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT69693%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for BT69693: 0
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-28 18:35:27 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Scrape type for ZJ17739: 2
2026-03-28 18:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47c5e322-430f-5d74-ae67-7f4abef66daf with identifier: ZJ17739
2026-03-28 18:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47c5e322-430f-5d74-ae67-7f4abef66daf with scrape type 2
2026-03-28 18:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47c5e322-430f-5d74-ae67-7f4abef66daf with scrape type 2
2026-03-28 18:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47c5e322-430f-5d74-ae67-7f4abef66daf, identifier: ZJ17739
2026-03-28 18:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47c5e322-430f-5d74-ae67-7f4abef66daf with identifier: ZJ17739
2026-03-28 18:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47c5e322-430f-5d74-ae67-7f4abef66daf with identifier: ZJ17739
2026-03-28 18:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47c5e322-430f-5d74-ae67-7f4abef66daf with identifier: ZJ17739 to the API
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:57Z',
 'fuel_type': 'petrol',
 'id': '47c5e322-430f-5d74-ae67-7f4abef66daf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ17739',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 195266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-15',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2013}
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ17739%27 HTTP/1.1" 200 None
2026-03-28 18:35:27 [auto1.de] INFO: Saving data for ZJ17739: {'auction_closing_time': 1774885557.0, 'created_time': 1774521303.723928, 'last_price_update_time': 1774722927.937532}
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ17739') HTTP/1.1" 204 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD13909%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for JD13909: 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF11415%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for TF11415: 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS62021%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for JS62021: 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS43037%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for MS43037: 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR15708%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for KR15708: 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG31115%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for LG31115: 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for DE35783: 2
2026-03-28 18:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with identifier: DE35783
2026-03-28 18:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with scrape type 2
2026-03-28 18:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with scrape type 2
2026-03-28 18:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e, identifier: DE35783
2026-03-28 18:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with identifier: DE35783
2026-03-28 18:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with identifier: DE35783
2026-03-28 18:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6633aba6-c9aa-5a57-a6f9-062945d9cd5e with identifier: DE35783 to the API
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:14:46Z',
 'fuel_type': 'petrol',
 'id': '6633aba6-c9aa-5a57-a6f9-062945d9cd5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE35783',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 125488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-23',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI Cupra 280',
 'transmission': 'automatic',
 'trim': 'Cupra 280',
 'year': 2014}
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE35783%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Saving data for DE35783: {'auction_closing_time': 1774883686.0, 'created_time': 1774118507.792209, 'last_price_update_time': 1774722928.588739}
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE35783') HTTP/1.1" 204 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX71045%27 HTTP/1.1" 200 None
2026-03-28 18:35:28 [auto1.de] INFO: Scrape type for UX71045: 0
2026-03-28 18:35:28 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-28 18:35:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:30 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS47503%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for NS47503: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS30363%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for WS30363: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69443%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for HB69443: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU97464%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for HU97464: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB16360%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for EB16360: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67874%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for MH67874: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91638%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for FY91638: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC05662%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for SC05662: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL31894%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for KL31894: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF03511%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for LF03511: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for RC37998: 2
2026-03-28 18:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba885203-b1ca-5466-9768-6753981ab855 with identifier: RC37998
2026-03-28 18:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba885203-b1ca-5466-9768-6753981ab855 with scrape type 2
2026-03-28 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba885203-b1ca-5466-9768-6753981ab855 with scrape type 2
2026-03-28 18:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba885203-b1ca-5466-9768-6753981ab855, identifier: RC37998
2026-03-28 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba885203-b1ca-5466-9768-6753981ab855 with identifier: RC37998
2026-03-28 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba885203-b1ca-5466-9768-6753981ab855 with identifier: RC37998
2026-03-28 18:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba885203-b1ca-5466-9768-6753981ab855 with identifier: RC37998 to the API
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:19:24Z',
 'fuel_type': 'petrol',
 'id': 'ba885203-b1ca-5466-9768-6753981ab855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC37998',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 132001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC37998%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Saving data for RC37998: {'auction_closing_time': 1774883964.0, 'created_time': 1774636285.547003, 'last_price_update_time': 1774722930.679419}
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC37998') HTTP/1.1" 204 0
2026-03-28 18:35:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25483%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for LJ25483: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV91936%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for RV91936: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV72825%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for BV72825: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY17492%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for FY17492: 0
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-28 18:35:30 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-28 18:35:30 [auto1.de] INFO: Scrape type for GU64592: 2
2026-03-28 18:35:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 394387b4-e393-540d-8c98-da0675d2b95f with identifier: GU64592
2026-03-28 18:35:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 394387b4-e393-540d-8c98-da0675d2b95f with scrape type 2
2026-03-28 18:35:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 394387b4-e393-540d-8c98-da0675d2b95f with scrape type 2
2026-03-28 18:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 394387b4-e393-540d-8c98-da0675d2b95f, identifier: GU64592
2026-03-28 18:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 394387b4-e393-540d-8c98-da0675d2b95f with identifier: GU64592
2026-03-28 18:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 394387b4-e393-540d-8c98-da0675d2b95f with identifier: GU64592
2026-03-28 18:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 394387b4-e393-540d-8c98-da0675d2b95f with identifier: GU64592 to the API
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:46:40Z',
 'fuel_type': 'diesel',
 'id': '394387b4-e393-540d-8c98-da0675d2b95f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU64592',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 213400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-10',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU64592%27 HTTP/1.1" 200 None
2026-03-28 18:35:31 [auto1.de] INFO: Saving data for GU64592: {'auction_closing_time': 1774885600.0, 'created_time': 1773427208.600461, 'last_price_update_time': 1774722931.680937}
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU64592') HTTP/1.1" 204 0
2026-03-28 18:35:31 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-28 18:35:31 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-28 18:35:31 [auto1.de] INFO: Scrape type for RX78682: 2
2026-03-28 18:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45437b91-973d-5635-a29a-02562e370deb with identifier: RX78682
2026-03-28 18:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45437b91-973d-5635-a29a-02562e370deb with scrape type 2
2026-03-28 18:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45437b91-973d-5635-a29a-02562e370deb with scrape type 2
2026-03-28 18:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45437b91-973d-5635-a29a-02562e370deb, identifier: RX78682
2026-03-28 18:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45437b91-973d-5635-a29a-02562e370deb with identifier: RX78682
2026-03-28 18:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45437b91-973d-5635-a29a-02562e370deb with identifier: RX78682
2026-03-28 18:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45437b91-973d-5635-a29a-02562e370deb with identifier: RX78682 to the API
2026-03-28 18:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:42:45Z',
 'fuel_type': 'diesel',
 'id': '45437b91-973d-5635-a29a-02562e370deb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX78682',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 186968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-15',
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel Trend',
 'transmission': 'automatic',
 'trim': 'Travel Trend',
 'year': 2017}
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78682%27 HTTP/1.1" 200 None
2026-03-28 18:35:32 [auto1.de] INFO: Saving data for RX78682: {'auction_closing_time': 1774885365.0, 'created_time': 1773917164.436302, 'last_price_update_time': 1774722932.21449}
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX78682') HTTP/1.1" 204 0
2026-03-28 18:35:32 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-28 18:35:32 [auto1.de] INFO: Scrape type for UP35116: 1
2026-03-28 18:35:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:33 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV37503%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Scrape type for SV37503: 0
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Scrape type for SV69696: 2
2026-03-28 18:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fde94542-025c-5bf8-b981-0abead488954 with identifier: SV69696
2026-03-28 18:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fde94542-025c-5bf8-b981-0abead488954 with scrape type 2
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fde94542-025c-5bf8-b981-0abead488954 with scrape type 2
2026-03-28 18:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fde94542-025c-5bf8-b981-0abead488954, identifier: SV69696
2026-03-28 18:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fde94542-025c-5bf8-b981-0abead488954 with identifier: SV69696
2026-03-28 18:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fde94542-025c-5bf8-b981-0abead488954 with identifier: SV69696
2026-03-28 18:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fde94542-025c-5bf8-b981-0abead488954 with identifier: SV69696 to the API
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:51Z',
 'fuel_type': 'diesel',
 'id': 'fde94542-025c-5bf8-b981-0abead488954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV69696',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 108785,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69696%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Saving data for SV69696: {'auction_closing_time': 1774883571.0, 'created_time': 1773945479.768048, 'last_price_update_time': 1774722933.509918}
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV69696') HTTP/1.1" 204 0
2026-03-28 18:35:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA36034%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Scrape type for BA36034: 0
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54130%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Scrape type for GT54130: 0
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD80559%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Scrape type for ZD80559: 0
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX38798%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Scrape type for BX38798: 0
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-28 18:35:33 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-28 18:35:33 [auto1.de] INFO: Scrape type for YF32306: 2
2026-03-28 18:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with identifier: YF32306
2026-03-28 18:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with scrape type 2
2026-03-28 18:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with scrape type 2
2026-03-28 18:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49, identifier: YF32306
2026-03-28 18:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with identifier: YF32306
2026-03-28 18:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with identifier: YF32306
2026-03-28 18:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49 with identifier: YF32306 to the API
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:30Z',
 'fuel_type': 'petrol',
 'id': 'a8dc9c2f-8cb9-51fc-b6a7-2be92d722b49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF32306',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 118044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-29',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF32306%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Saving data for YF32306: {'auction_closing_time': 1774883610.0, 'created_time': 1774549839.742128, 'last_price_update_time': 1774722934.09025}
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF32306') HTTP/1.1" 204 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for DJ74321: 2
2026-03-28 18:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f32e8e14-78a5-5156-8601-3eac092f8a78 with identifier: DJ74321
2026-03-28 18:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f32e8e14-78a5-5156-8601-3eac092f8a78 with scrape type 2
2026-03-28 18:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f32e8e14-78a5-5156-8601-3eac092f8a78 with scrape type 2
2026-03-28 18:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f32e8e14-78a5-5156-8601-3eac092f8a78, identifier: DJ74321
2026-03-28 18:35:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP35116/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f32e8e14-78a5-5156-8601-3eac092f8a78 with identifier: DJ74321
2026-03-28 18:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f32e8e14-78a5-5156-8601-3eac092f8a78 with identifier: DJ74321
2026-03-28 18:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f32e8e14-78a5-5156-8601-3eac092f8a78 with identifier: DJ74321 to the API
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:01:39Z',
 'fuel_type': 'petrol',
 'id': 'f32e8e14-78a5-5156-8601-3eac092f8a78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ74321',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 86036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-29',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ74321%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Saving data for DJ74321: {'auction_closing_time': 1774882899.0, 'created_time': 1774002238.319657, 'last_price_update_time': 1774722934.672602}
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DJ74321') HTTP/1.1" 204 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU72034%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for EU72034: 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD36450%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for ZD36450: 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK18306%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for PK18306: 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK39186%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for PK39186: 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH66881%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for WH66881: 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG82987%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for RG82987: 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND02727%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for ND02727: 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ18132%27 HTTP/1.1" 200 None
2026-03-28 18:35:34 [auto1.de] INFO: Scrape type for WJ18132: 0
2026-03-28 18:35:34 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-28 18:35:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:35 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ23133%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Scrape type for YJ23133: 0
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR30174%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Scrape type for JR30174: 0
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU09743%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Scrape type for XU09743: 0
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX51992%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Scrape type for SX51992: 0
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS68419%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Scrape type for SS68419: 0
2026-03-28 18:35:35 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-28 18:35:35 [auto1.de] INFO: Scrape type for KT07926: 2
2026-03-28 18:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with identifier: KT07926
2026-03-28 18:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with scrape type 2
2026-03-28 18:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with scrape type 2
2026-03-28 18:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad, identifier: KT07926
2026-03-28 18:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with identifier: KT07926
2026-03-28 18:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with identifier: KT07926
2026-03-28 18:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad with identifier: KT07926 to the API
2026-03-28 18:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:23Z',
 'fuel_type': 'petrol',
 'id': 'dcb5b9c7-b08e-5e6d-ab60-a9ced96d94ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT07926',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 99700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-25',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT07926%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Saving data for KT07926: {'auction_closing_time': 1774885643.0, 'created_time': 1774636243.237824, 'last_price_update_time': 1774722936.20282}
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT07926') HTTP/1.1" 204 0
2026-03-28 18:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC50567%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for MC50567: 0
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ46352%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for WZ46352: 0
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75190%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for NY75190: 0
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD91904%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for TD91904: 0
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG67628%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for JG67628: 0
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK39186%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for JK39186: 0
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for FP97739: 2
2026-03-28 18:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with identifier: FP97739
2026-03-28 18:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with scrape type 2
2026-03-28 18:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with scrape type 2
2026-03-28 18:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da, identifier: FP97739
2026-03-28 18:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with identifier: FP97739
2026-03-28 18:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with identifier: FP97739
2026-03-28 18:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a0536d6-12fc-56fc-b68f-8b7658cfc6da with identifier: FP97739 to the API
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:11:34Z',
 'fuel_type': 'diesel',
 'id': '1a0536d6-12fc-56fc-b68f-8b7658cfc6da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP97739',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 109451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-22',
 'seller_name': None,
 'title': 'Fiat Doblo 1.6 JTDM SX Maxi Kasten',
 'transmission': 'manual',
 'trim': 'SX Maxi Kasten',
 'year': 2010}
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP97739%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Saving data for FP97739: {'auction_closing_time': 1774883494.0, 'created_time': 1774522390.398692, 'last_price_update_time': 1774722936.861346}
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP97739') HTTP/1.1" 204 0
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB09525%27 HTTP/1.1" 200 None
2026-03-28 18:35:36 [auto1.de] INFO: Scrape type for FB09525: 0
2026-03-28 18:35:36 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-28 18:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG82543%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for HG82543: 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX42000%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for KX42000: 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH85992%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for YH85992: 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for KY48204: 2
2026-03-28 18:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with identifier: KY48204
2026-03-28 18:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with scrape type 2
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with scrape type 2
2026-03-28 18:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd, identifier: KY48204
2026-03-28 18:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP35116> (referer: https://www.auto1.com/v1/car-details-view/UP35116/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with identifier: KY48204
2026-03-28 18:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with identifier: KY48204
2026-03-28 18:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cfd7e68-85c0-54f0-924f-1a0823f9fcfd with identifier: KY48204 to the API
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:28:48Z',
 'fuel_type': 'petrol',
 'id': '3cfd7e68-85c0-54f0-924f-1a0823f9fcfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY48204',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 42416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-05-19',
 'seller_name': None,
 'title': 'Opel Meriva 1.8 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2005}
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY48204%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Saving data for KY48204: {'auction_closing_time': 1774884528.0, 'created_time': 1774636360.016592, 'last_price_update_time': 1774722937.460743}
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY48204') HTTP/1.1" 204 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL48230%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for HL48230: 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG07111%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for GG07111: 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS42902%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for PS42902: 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY59901%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for UY59901: 0
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-28 18:35:37 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB47051%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [auto1.de] INFO: Scrape type for LB47051: 0
2026-03-28 18:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b059128e-25dc-536a-8b18-8c3e0c2c3429 with identifier: UP35116
2026-03-28 18:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b059128e-25dc-536a-8b18-8c3e0c2c3429 with scrape type 1
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b059128e-25dc-536a-8b18-8c3e0c2c3429
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F75%252F27759a862e252b7b24684ae48a5902f0%252Fpa%252FUP35116_a00bb674747c61d69260a2a460dde065.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_a00bb674747c61d69260a2a460dde065.jpg already downloaded
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F75%252F27759a862e252b7b24684ae48a5902f0%252Fpa%252FUP35116_6e2f027f151464f03835ec019964bc01.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_6e2f027f151464f03835ec019964bc01.jpg already downloaded
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F75%252F27759a862e252b7b24684ae48a5902f0%252Fpa%252FUP35116_de28d986e9893391c4bbb2e1247fb98c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_de28d986e9893391c4bbb2e1247fb98c.jpg already downloaded
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F75%252F27759a862e252b7b24684ae48a5902f0%252Fpa%252FUP35116_0a61b04819aac2ca2846a74261de69d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_0a61b04819aac2ca2846a74261de69d0.jpg already downloaded
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F75%252F27759a862e252b7b24684ae48a5902f0%252Fpa%252FUP35116_ee12415f67095f9e717c7bf5f67aa9d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_ee12415f67095f9e717c7bf5f67aa9d9.jpg already downloaded
2026-03-28 18:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b059128e-25dc-536a-8b18-8c3e0c2c3429, identifier: UP35116
2026-03-28 18:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b059128e-25dc-536a-8b18-8c3e0c2c3429 with identifier: UP35116
2026-03-28 18:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b059128e-25dc-536a-8b18-8c3e0c2c3429 with identifier: UP35116
2026-03-28 18:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b059128e-25dc-536a-8b18-8c3e0c2c3429 with identifier: UP35116 to the API
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UP35116>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:22:27Z',
 'fuel_type': 'diesel',
 'id': 'b059128e-25dc-536a-8b18-8c3e0c2c3429',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP35116',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 266807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_a00bb674747c61d69260a2a460dde065.jpg',
                'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_6e2f027f151464f03835ec019964bc01.jpg',
                'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_de28d986e9893391c4bbb2e1247fb98c.jpg',
                'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_0a61b04819aac2ca2846a74261de69d0.jpg',
                'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_ee12415f67095f9e717c7bf5f67aa9d9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b059128e-25dc-536a-8b18-8c3e0c2c3429/b059128e-25dc-536a-8b18-8c3e0c2c3429_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_a00bb674747c61d69260a2a460dde065.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b059128e-25dc-536a-8b18-8c3e0c2c3429/b059128e-25dc-536a-8b18-8c3e0c2c3429_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_6e2f027f151464f03835ec019964bc01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b059128e-25dc-536a-8b18-8c3e0c2c3429/b059128e-25dc-536a-8b18-8c3e0c2c3429_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81979,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_de28d986e9893391c4bbb2e1247fb98c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b059128e-25dc-536a-8b18-8c3e0c2c3429/b059128e-25dc-536a-8b18-8c3e0c2c3429_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_0a61b04819aac2ca2846a74261de69d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b059128e-25dc-536a-8b18-8c3e0c2c3429/b059128e-25dc-536a-8b18-8c3e0c2c3429_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/75/27759a862e252b7b24684ae48a5902f0/pa/UP35116_ee12415f67095f9e717c7bf5f67aa9d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Move',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2012}
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP35116%27 HTTP/1.1" 200 None
2026-03-28 18:35:38 [auto1.de] INFO: Saving data for UP35116: {'created_time': 1774722938.076379, 'last_price_update_time': 1774722938.076395, 'auction_closing_time': 1774884147.0}
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP35116') HTTP/1.1" 204 0
2026-03-28 18:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:39 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR01003%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Scrape type for NR01003: 0
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Scrape type for TJ52471: 2
2026-03-28 18:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c66b7fc-5207-5355-826a-862308f9820c with identifier: TJ52471
2026-03-28 18:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c66b7fc-5207-5355-826a-862308f9820c with scrape type 2
2026-03-28 18:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c66b7fc-5207-5355-826a-862308f9820c with scrape type 2
2026-03-28 18:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c66b7fc-5207-5355-826a-862308f9820c, identifier: TJ52471
2026-03-28 18:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c66b7fc-5207-5355-826a-862308f9820c with identifier: TJ52471
2026-03-28 18:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c66b7fc-5207-5355-826a-862308f9820c with identifier: TJ52471
2026-03-28 18:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c66b7fc-5207-5355-826a-862308f9820c with identifier: TJ52471 to the API
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:56:21Z',
 'fuel_type': 'petrol',
 'id': '1c66b7fc-5207-5355-826a-862308f9820c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ52471',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 167124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-23',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ52471%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Saving data for TJ52471: {'auction_closing_time': 1774886181.0, 'created_time': 1774522092.169159, 'last_price_update_time': 1774722939.592507}
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ52471') HTTP/1.1" 204 0
2026-03-28 18:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB05749%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Scrape type for BB05749: 0
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96040%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Scrape type for BV96040: 0
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU38078%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Scrape type for AU38078: 0
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-28 18:35:39 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-28 18:35:39 [auto1.de] INFO: Scrape type for MF11383: 2
2026-03-28 18:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with identifier: MF11383
2026-03-28 18:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with scrape type 2
2026-03-28 18:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with scrape type 2
2026-03-28 18:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f, identifier: MF11383
2026-03-28 18:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with identifier: MF11383
2026-03-28 18:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with identifier: MF11383
2026-03-28 18:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f with identifier: MF11383 to the API
2026-03-28 18:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:46:47Z',
 'fuel_type': 'diesel',
 'id': '34d5f7b0-2a06-5ceb-b5e0-575cc2484d5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF11383',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 150606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2013}
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF11383%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Saving data for MF11383: {'auction_closing_time': 1774885607.0, 'created_time': 1773427205.967907, 'last_price_update_time': 1774722940.121315}
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF11383') HTTP/1.1" 204 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93583%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for FK93583: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT64251%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for HT64251: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA11296%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for CA11296: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC52895%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for RC52895: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT46739%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for LT46739: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV64840%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for CV64840: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR45011%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for WR45011: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK97708%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for YK97708: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97741%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for AU97741: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX44464%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for HX44464: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE57640%27 HTTP/1.1" 200 None
2026-03-28 18:35:40 [auto1.de] INFO: Scrape type for XE57640: 0
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-28 18:35:40 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-28 18:35:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:41 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD55568%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Scrape type for WD55568: 0
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT11512%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Scrape type for TT11512: 0
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH89058%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Scrape type for EH89058: 0
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-28 18:35:41 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-28 18:35:41 [auto1.de] INFO: Scrape type for YU70640: 2
2026-03-28 18:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0765f866-dd67-5f13-a246-6ff56ae7d349 with identifier: YU70640
2026-03-28 18:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0765f866-dd67-5f13-a246-6ff56ae7d349 with scrape type 2
2026-03-28 18:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0765f866-dd67-5f13-a246-6ff56ae7d349 with scrape type 2
2026-03-28 18:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0765f866-dd67-5f13-a246-6ff56ae7d349, identifier: YU70640
2026-03-28 18:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0765f866-dd67-5f13-a246-6ff56ae7d349 with identifier: YU70640
2026-03-28 18:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0765f866-dd67-5f13-a246-6ff56ae7d349 with identifier: YU70640
2026-03-28 18:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0765f866-dd67-5f13-a246-6ff56ae7d349 with identifier: YU70640 to the API
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:33:28Z',
 'fuel_type': 'diesel',
 'id': '0765f866-dd67-5f13-a246-6ff56ae7d349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU70640',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 201361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-27',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU70640%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Saving data for YU70640: {'auction_closing_time': 1774884808.0, 'created_time': 1774522137.946633, 'last_price_update_time': 1774722942.070222}
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU70640') HTTP/1.1" 204 0
2026-03-28 18:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA59954%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for XA59954: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68722%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for BS68722: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR59987%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for KR59987: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89302%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for ZL89302: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for WV53584: 2
2026-03-28 18:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with identifier: WV53584
2026-03-28 18:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with scrape type 2
2026-03-28 18:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with scrape type 2
2026-03-28 18:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13394db8-552d-5fc2-8fc9-8259ed5b2c07, identifier: WV53584
2026-03-28 18:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with identifier: WV53584
2026-03-28 18:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with identifier: WV53584
2026-03-28 18:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13394db8-552d-5fc2-8fc9-8259ed5b2c07 with identifier: WV53584 to the API
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:54:26Z',
 'fuel_type': 'diesel',
 'id': '13394db8-552d-5fc2-8fc9-8259ed5b2c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV53584',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 151801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-11',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 400 d L 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'L 4Matic AMG Line',
 'year': 2019}
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV53584%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Saving data for WV53584: {'auction_closing_time': 1774886066.0, 'created_time': 1773945924.996212, 'last_price_update_time': 1774722942.680521}
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV53584') HTTP/1.1" 204 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX82785%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for HX82785: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP94641%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for KP94641: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN84809%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for GN84809: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ54274%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for TJ54274: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: US02416
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK64701%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for FK64701: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD99837%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for KD99837: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT92909%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for GT92909: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP65975%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for BP65975: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR69124%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for VR69124: 0
2026-03-28 18:35:42 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-28 18:35:42 [auto1.de] INFO: Scrape type for SP71400: 2
2026-03-28 18:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with identifier: SP71400
2026-03-28 18:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with scrape type 2
2026-03-28 18:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with scrape type 2
2026-03-28 18:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e, identifier: SP71400
2026-03-28 18:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with identifier: SP71400
2026-03-28 18:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with identifier: SP71400
2026-03-28 18:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84fc03d3-2ba8-56eb-b011-4d7ba72fe54e with identifier: SP71400 to the API
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:11Z',
 'fuel_type': 'petrol',
 'id': '84fc03d3-2ba8-56eb-b011-4d7ba72fe54e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP71400',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 45017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-28',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP71400%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Saving data for SP71400: {'auction_closing_time': 1774882931.0, 'created_time': 1773428309.461068, 'last_price_update_time': 1774722943.34924}
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP71400') HTTP/1.1" 204 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT79226%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for JT79226: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC27244%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for FC27244: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR76399%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for CR76399: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY70159%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for EY70159: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB03124%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for TB03124: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN04335%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for ZN04335: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63884%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for SR63884: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM38204%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for EM38204: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: MR29539
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR29539%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for MR29539: 0
2026-03-28 18:35:43 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74558%27 HTTP/1.1" 200 None
2026-03-28 18:35:43 [auto1.de] INFO: Scrape type for ZA74558: 0
2026-03-28 18:35:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:44 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL19330%27 HTTP/1.1" 200 None
2026-03-28 18:35:44 [auto1.de] INFO: Scrape type for UL19330: 0
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK20650%27 HTTP/1.1" 200 None
2026-03-28 18:35:44 [auto1.de] INFO: Scrape type for KK20650: 0
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-28 18:35:44 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-28 18:35:44 [auto1.de] INFO: Scrape type for DH60406: 2
2026-03-28 18:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3cfc1e1-806d-51fe-8ae9-51373de03b77 with identifier: DH60406
2026-03-28 18:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3cfc1e1-806d-51fe-8ae9-51373de03b77 with scrape type 2
2026-03-28 18:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3cfc1e1-806d-51fe-8ae9-51373de03b77 with scrape type 2
2026-03-28 18:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3cfc1e1-806d-51fe-8ae9-51373de03b77, identifier: DH60406
2026-03-28 18:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3cfc1e1-806d-51fe-8ae9-51373de03b77 with identifier: DH60406
2026-03-28 18:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3cfc1e1-806d-51fe-8ae9-51373de03b77 with identifier: DH60406
2026-03-28 18:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3cfc1e1-806d-51fe-8ae9-51373de03b77 with identifier: DH60406 to the API
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:00:18Z',
 'fuel_type': 'diesel',
 'id': 'e3cfc1e1-806d-51fe-8ae9-51373de03b77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DH60406',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 123545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-28',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 e-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2013}
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH60406%27 HTTP/1.1" 200 None
2026-03-28 18:35:44 [auto1.de] INFO: Saving data for DH60406: {'auction_closing_time': 1774882818.0, 'created_time': 1774118160.60647, 'last_price_update_time': 1774722944.907707}
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DH60406') HTTP/1.1" 204 0
2026-03-28 18:35:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV98525%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for LV98525: 0
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG01076%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for VG01076: 0
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF90181%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for FF90181: 0
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT51756%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for ZT51756: 0
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS26933%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for PS26933: 0
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL45586%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for XL45586: 0
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for JF78286: 2
2026-03-28 18:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78664ca-19d5-52ce-8a2b-409bbf506043 with identifier: JF78286
2026-03-28 18:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78664ca-19d5-52ce-8a2b-409bbf506043 with scrape type 2
2026-03-28 18:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e78664ca-19d5-52ce-8a2b-409bbf506043 with scrape type 2
2026-03-28 18:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e78664ca-19d5-52ce-8a2b-409bbf506043, identifier: JF78286
2026-03-28 18:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e78664ca-19d5-52ce-8a2b-409bbf506043 with identifier: JF78286
2026-03-28 18:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e78664ca-19d5-52ce-8a2b-409bbf506043 with identifier: JF78286
2026-03-28 18:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e78664ca-19d5-52ce-8a2b-409bbf506043 with identifier: JF78286 to the API
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:24:33Z',
 'fuel_type': 'diesel',
 'id': 'e78664ca-19d5-52ce-8a2b-409bbf506043',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF78286',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 137618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-09',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Comfortline BlueMotion',
 'year': 2019}
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF78286%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Saving data for JF78286: {'auction_closing_time': 1774884273.0, 'created_time': 1774636542.923446, 'last_price_update_time': 1774722945.569701}
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF78286') HTTP/1.1" 204 0
2026-03-28 18:35:45 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-28 18:35:45 [auto1.de] INFO: Scrape type for AJ08508: 2
2026-03-28 18:35:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ad37e9-1379-5401-9c38-58b5aad6e208 with identifier: AJ08508
2026-03-28 18:35:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ad37e9-1379-5401-9c38-58b5aad6e208 with scrape type 2
2026-03-28 18:35:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66ad37e9-1379-5401-9c38-58b5aad6e208 with scrape type 2
2026-03-28 18:35:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66ad37e9-1379-5401-9c38-58b5aad6e208, identifier: AJ08508
2026-03-28 18:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66ad37e9-1379-5401-9c38-58b5aad6e208 with identifier: AJ08508
2026-03-28 18:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66ad37e9-1379-5401-9c38-58b5aad6e208 with identifier: AJ08508
2026-03-28 18:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66ad37e9-1379-5401-9c38-58b5aad6e208 with identifier: AJ08508 to the API
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:20:50Z',
 'fuel_type': 'diesel',
 'id': '66ad37e9-1379-5401-9c38-58b5aad6e208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ08508',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 119886,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2021}
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08508%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Saving data for AJ08508: {'auction_closing_time': 1774884050.0, 'created_time': 1774522302.359298, 'last_price_update_time': 1774722946.09412}
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ08508') HTTP/1.1" 204 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT94690%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for WT94690: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW09174%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for JW09174: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU78971%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for LU78971: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM23773%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for MM23773: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE42572%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for DE42572: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH92340%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for JH92340: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS04983%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for NS04983: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY22177%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for FY22177: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS84546%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for ZS84546: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG76002%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for NG76002: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL01177%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for JL01177: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD72910%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for BD72910: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP80168%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for PP80168: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC80403%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for RC80403: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for MV27472: 2
2026-03-28 18:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41003dae-0779-592a-b3ee-b2a6717b4e82 with identifier: MV27472
2026-03-28 18:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41003dae-0779-592a-b3ee-b2a6717b4e82 with scrape type 2
2026-03-28 18:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41003dae-0779-592a-b3ee-b2a6717b4e82 with scrape type 2
2026-03-28 18:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41003dae-0779-592a-b3ee-b2a6717b4e82, identifier: MV27472
2026-03-28 18:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41003dae-0779-592a-b3ee-b2a6717b4e82 with identifier: MV27472
2026-03-28 18:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41003dae-0779-592a-b3ee-b2a6717b4e82 with identifier: MV27472
2026-03-28 18:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41003dae-0779-592a-b3ee-b2a6717b4e82 with identifier: MV27472 to the API
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:17:39Z',
 'fuel_type': 'diesel',
 'id': '41003dae-0779-592a-b3ee-b2a6717b4e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV27472',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Master',
 'odometer': 90849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-17',
 'seller_name': None,
 'title': 'Renault Master 2.3 dCi L2H2 HKa 3,3t',
 'transmission': 'manual',
 'trim': 'L2H2 HKa 3,3t',
 'year': 2018}
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV27472%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Saving data for MV27472: {'auction_closing_time': 1774883859.0, 'created_time': 1773399502.280106, 'last_price_update_time': 1774722946.792609}
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV27472') HTTP/1.1" 204 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ71122%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for AJ71122: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27977%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for GB27977: 0
2026-03-28 18:35:46 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM13382%27 HTTP/1.1" 200 None
2026-03-28 18:35:46 [auto1.de] INFO: Scrape type for DM13382: 0
2026-03-28 18:35:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:47 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:47 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-28 18:35:47 [auto1.de] INFO: Scrape type for XR73410: 2
2026-03-28 18:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1733974a-2168-5da2-8ec7-3b9d2e4c635f with identifier: XR73410
2026-03-28 18:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1733974a-2168-5da2-8ec7-3b9d2e4c635f with scrape type 2
2026-03-28 18:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1733974a-2168-5da2-8ec7-3b9d2e4c635f with scrape type 2
2026-03-28 18:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1733974a-2168-5da2-8ec7-3b9d2e4c635f, identifier: XR73410
2026-03-28 18:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1733974a-2168-5da2-8ec7-3b9d2e4c635f with identifier: XR73410
2026-03-28 18:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1733974a-2168-5da2-8ec7-3b9d2e4c635f with identifier: XR73410
2026-03-28 18:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1733974a-2168-5da2-8ec7-3b9d2e4c635f with identifier: XR73410 to the API
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:13Z',
 'fuel_type': 'petrol',
 'id': '1733974a-2168-5da2-8ec7-3b9d2e4c635f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR73410',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 134814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-05',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR73410%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Saving data for XR73410: {'auction_closing_time': 1774886233.0, 'created_time': 1774521920.616533, 'last_price_update_time': 1774722948.310434}
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR73410') HTTP/1.1" 204 0
2026-03-28 18:35:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32906%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Scrape type for PR32906: 0
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Scrape type for BG13835: 2
2026-03-28 18:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with identifier: BG13835
2026-03-28 18:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with scrape type 2
2026-03-28 18:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with scrape type 2
2026-03-28 18:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a, identifier: BG13835
2026-03-28 18:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with identifier: BG13835
2026-03-28 18:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with identifier: BG13835
2026-03-28 18:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed816ebe-4d4c-5c66-ba4c-2f343082fe4a with identifier: BG13835 to the API
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:35:31Z',
 'fuel_type': 'petrol',
 'id': 'ed816ebe-4d4c-5c66-ba4c-2f343082fe4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG13835',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 201308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-21',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2012}
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG13835%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Saving data for BG13835: {'auction_closing_time': 1774884931.0, 'created_time': 1774522012.821496, 'last_price_update_time': 1774722948.804173}
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG13835') HTTP/1.1" 204 0
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ03907%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Scrape type for BJ03907: 0
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE52525%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Scrape type for BE52525: 0
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX79678%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Scrape type for KX79678: 0
2026-03-28 18:35:48 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-28 18:35:48 [auto1.de] INFO: Scrape type for ZD84444: 2
2026-03-28 18:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 875a71bf-a439-5849-b5ae-90a3ce035f2e with identifier: ZD84444
2026-03-28 18:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 875a71bf-a439-5849-b5ae-90a3ce035f2e with scrape type 2
2026-03-28 18:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 875a71bf-a439-5849-b5ae-90a3ce035f2e with scrape type 2
2026-03-28 18:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 875a71bf-a439-5849-b5ae-90a3ce035f2e, identifier: ZD84444
2026-03-28 18:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 875a71bf-a439-5849-b5ae-90a3ce035f2e with identifier: ZD84444
2026-03-28 18:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 875a71bf-a439-5849-b5ae-90a3ce035f2e with identifier: ZD84444
2026-03-28 18:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 875a71bf-a439-5849-b5ae-90a3ce035f2e with identifier: ZD84444 to the API
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:00:17Z',
 'fuel_type': 'petrol',
 'id': '875a71bf-a439-5849-b5ae-90a3ce035f2e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD84444',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 208550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD84444%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Saving data for ZD84444: {'auction_closing_time': 1774882817.0, 'created_time': 1774521625.900573, 'last_price_update_time': 1774722949.2949}
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD84444') HTTP/1.1" 204 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS79616%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for AS79616: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY24056%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for KY24056: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK05347%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for RK05347: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86778%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for XC86778: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK09620%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for MK09620: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD07804%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for FD07804: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU14663%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for EU14663: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ94450%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for CZ94450: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS96565%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for BS96565: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK93420%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for FK93420: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL71232%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for AL71232: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP67168%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for TP67168: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH93335%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for YH93335: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA08526%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for YA08526: 0
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-28 18:35:49 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA99169%27 HTTP/1.1" 200 None
2026-03-28 18:35:49 [auto1.de] INFO: Scrape type for HA99169: 0
2026-03-28 18:35:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:50 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:50 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-28 18:35:50 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60092%27 HTTP/1.1" 200 None
2026-03-28 18:35:50 [auto1.de] INFO: Scrape type for YM60092: 0
2026-03-28 18:35:50 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL23432%27 HTTP/1.1" 200 None
2026-03-28 18:35:50 [auto1.de] INFO: Scrape type for GL23432: 0
2026-03-28 18:35:50 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-28 18:35:50 [auto1.de] INFO: Scrape type for GU28360: 2
2026-03-28 18:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4cc9f20-ea51-5320-8886-ed781248e844 with identifier: GU28360
2026-03-28 18:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4cc9f20-ea51-5320-8886-ed781248e844 with scrape type 2
2026-03-28 18:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4cc9f20-ea51-5320-8886-ed781248e844 with scrape type 2
2026-03-28 18:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4cc9f20-ea51-5320-8886-ed781248e844, identifier: GU28360
2026-03-28 18:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4cc9f20-ea51-5320-8886-ed781248e844 with identifier: GU28360
2026-03-28 18:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4cc9f20-ea51-5320-8886-ed781248e844 with identifier: GU28360
2026-03-28 18:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4cc9f20-ea51-5320-8886-ed781248e844 with identifier: GU28360 to the API
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:25Z',
 'fuel_type': 'petrol',
 'id': 'a4cc9f20-ea51-5320-8886-ed781248e844',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU28360',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 106253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'Seat Mii 1.0 Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2013}
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU28360%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [auto1.de] INFO: Saving data for GU28360: {'auction_closing_time': 1774886185.0, 'created_time': 1774636513.868887, 'last_price_update_time': 1774722951.062478}
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU28360') HTTP/1.1" 204 0
2026-03-28 18:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [auto1.de] INFO: Scrape type for NY39865: 2
2026-03-28 18:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with identifier: NY39865
2026-03-28 18:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with scrape type 2
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with scrape type 2
2026-03-28 18:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 729c82fa-8f39-50e2-ae15-3b8acda29ec6, identifier: NY39865
2026-03-28 18:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with identifier: NY39865
2026-03-28 18:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with identifier: NY39865
2026-03-28 18:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 729c82fa-8f39-50e2-ae15-3b8acda29ec6 with identifier: NY39865 to the API
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:04:23Z',
 'fuel_type': 'petrol',
 'id': '729c82fa-8f39-50e2-ae15-3b8acda29ec6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY39865',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 267719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-13',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 320 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2003}
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY39865%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [auto1.de] INFO: Saving data for NY39865: {'auction_closing_time': 1774883063.0, 'created_time': 1774636252.858283, 'last_price_update_time': 1774722951.618277}
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY39865') HTTP/1.1" 204 0
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM89123%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [auto1.de] INFO: Scrape type for YM89123: 0
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE20553%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [auto1.de] INFO: Scrape type for JE20553: 0
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE95833%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [auto1.de] INFO: Scrape type for HE95833: 0
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-28 18:35:51 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-28 18:35:51 [auto1.de] INFO: Scrape type for BH40486: 2
2026-03-28 18:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 551c1ada-bf78-5be3-9631-177dbd709f4d with identifier: BH40486
2026-03-28 18:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551c1ada-bf78-5be3-9631-177dbd709f4d with scrape type 2
2026-03-28 18:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 551c1ada-bf78-5be3-9631-177dbd709f4d with scrape type 2
2026-03-28 18:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 551c1ada-bf78-5be3-9631-177dbd709f4d, identifier: BH40486
2026-03-28 18:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 551c1ada-bf78-5be3-9631-177dbd709f4d with identifier: BH40486
2026-03-28 18:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 551c1ada-bf78-5be3-9631-177dbd709f4d with identifier: BH40486
2026-03-28 18:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 551c1ada-bf78-5be3-9631-177dbd709f4d with identifier: BH40486 to the API
2026-03-28 18:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:24:22Z',
 'fuel_type': 'petrol',
 'id': '551c1ada-bf78-5be3-9631-177dbd709f4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH40486',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 97459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-19',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Ultimate Start/Stop',
 'transmission': 'manual',
 'trim': 'Ultimate Start/Stop',
 'year': 2018}
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH40486%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Saving data for BH40486: {'auction_closing_time': 1774884262.0, 'created_time': 1774117874.201827, 'last_price_update_time': 1774722952.128873}
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH40486') HTTP/1.1" 204 0
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ72661%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for PJ72661: 0
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU55937%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for EU55937: 0
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for FC58368: 2
2026-03-28 18:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20c71355-aa31-5840-8206-1ca39c023845 with identifier: FC58368
2026-03-28 18:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20c71355-aa31-5840-8206-1ca39c023845 with scrape type 2
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20c71355-aa31-5840-8206-1ca39c023845 with scrape type 2
2026-03-28 18:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20c71355-aa31-5840-8206-1ca39c023845, identifier: FC58368
2026-03-28 18:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20c71355-aa31-5840-8206-1ca39c023845 with identifier: FC58368
2026-03-28 18:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20c71355-aa31-5840-8206-1ca39c023845 with identifier: FC58368
2026-03-28 18:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20c71355-aa31-5840-8206-1ca39c023845 with identifier: FC58368 to the API
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:48:55Z',
 'fuel_type': 'petrol',
 'id': '20c71355-aa31-5840-8206-1ca39c023845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC58368',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 214437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-13',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSIe',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC58368%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Saving data for FC58368: {'auction_closing_time': 1774885735.0, 'created_time': 1774522125.216577, 'last_price_update_time': 1774722952.588819}
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC58368') HTTP/1.1" 204 0
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR16166%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for TR16166: 0
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL72428%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for TL72428: 0
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV75239%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for KV75239: 0
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN22561%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for CN22561: 0
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-28 18:35:52 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-28 18:35:52 [auto1.de] INFO: Scrape type for CT75216: 2
2026-03-28 18:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841da4fd-f475-5cfe-9962-457dfb47561e with identifier: CT75216
2026-03-28 18:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841da4fd-f475-5cfe-9962-457dfb47561e with scrape type 2
2026-03-28 18:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841da4fd-f475-5cfe-9962-457dfb47561e with scrape type 2
2026-03-28 18:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 841da4fd-f475-5cfe-9962-457dfb47561e, identifier: CT75216
2026-03-28 18:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 841da4fd-f475-5cfe-9962-457dfb47561e with identifier: CT75216
2026-03-28 18:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 841da4fd-f475-5cfe-9962-457dfb47561e with identifier: CT75216
2026-03-28 18:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 841da4fd-f475-5cfe-9962-457dfb47561e with identifier: CT75216 to the API
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:33:40Z',
 'fuel_type': 'diesel',
 'id': '841da4fd-f475-5cfe-9962-457dfb47561e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT75216',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 51621,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT75216%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Saving data for CT75216: {'auction_closing_time': 1774884820.0, 'created_time': 1774522493.368228, 'last_price_update_time': 1774722953.271124}
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT75216') HTTP/1.1" 204 0
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN20430%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Scrape type for WN20430: 0
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84142%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Scrape type for NV84142: 0
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH54779%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Scrape type for ZH54779: 0
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP55762%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Scrape type for CP55762: 0
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE30876%27 HTTP/1.1" 200 None
2026-03-28 18:35:53 [auto1.de] INFO: Scrape type for UE30876: 0
2026-03-28 18:35:53 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-28 18:35:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:54 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY98011%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for EY98011: 0
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for MK93259: 2
2026-03-28 18:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with identifier: MK93259
2026-03-28 18:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with scrape type 2
2026-03-28 18:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with scrape type 2
2026-03-28 18:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 103f26e6-ca00-57ba-b79d-7de5efc56ff7, identifier: MK93259
2026-03-28 18:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with identifier: MK93259
2026-03-28 18:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with identifier: MK93259
2026-03-28 18:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 103f26e6-ca00-57ba-b79d-7de5efc56ff7 with identifier: MK93259 to the API
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:03:21Z',
 'fuel_type': 'petrol',
 'id': '103f26e6-ca00-57ba-b79d-7de5efc56ff7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK93259',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 72450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-27',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK93259%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Saving data for MK93259: {'auction_closing_time': 1774883001.0, 'created_time': 1774636503.497648, 'last_price_update_time': 1774722954.632588}
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK93259') HTTP/1.1" 204 0
2026-03-28 18:35:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT09686%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for JT09686: 0
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-28 18:35:54 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-28 18:35:54 [auto1.de] INFO: Scrape type for NY21344: 2
2026-03-28 18:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b97d0590-ebcb-5840-9e0d-284c82e25b68 with identifier: NY21344
2026-03-28 18:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b97d0590-ebcb-5840-9e0d-284c82e25b68 with scrape type 2
2026-03-28 18:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b97d0590-ebcb-5840-9e0d-284c82e25b68 with scrape type 2
2026-03-28 18:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b97d0590-ebcb-5840-9e0d-284c82e25b68, identifier: NY21344
2026-03-28 18:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b97d0590-ebcb-5840-9e0d-284c82e25b68 with identifier: NY21344
2026-03-28 18:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b97d0590-ebcb-5840-9e0d-284c82e25b68 with identifier: NY21344
2026-03-28 18:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b97d0590-ebcb-5840-9e0d-284c82e25b68 with identifier: NY21344 to the API
2026-03-28 18:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:22:17Z',
 'fuel_type': 'petrol',
 'id': 'b97d0590-ebcb-5840-9e0d-284c82e25b68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY21344',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo X',
 'odometer': 45748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-27',
 'seller_name': None,
 'title': 'Toyota Aygo X 1.0 VVT-i Team D',
 'transmission': 'automatic',
 'trim': 'Team D',
 'year': 2024}
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21344%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Saving data for NY21344: {'auction_closing_time': 1774884137.0, 'created_time': 1774636329.12714, 'last_price_update_time': 1774722955.174575}
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY21344') HTTP/1.1" 204 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS09930%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for NS09930: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB40051%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for CB40051: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB70808%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for HB70808: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: HL07149
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL07149%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for HL07149: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR43208%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for XR43208: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA11075%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for LA11075: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX54451%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for BX54451: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for KU93910: 2
2026-03-28 18:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with identifier: KU93910
2026-03-28 18:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with scrape type 2
2026-03-28 18:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with scrape type 2
2026-03-28 18:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f92dfd0-a12d-5b34-b508-80b1b87f1919, identifier: KU93910
2026-03-28 18:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with identifier: KU93910
2026-03-28 18:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with identifier: KU93910
2026-03-28 18:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f92dfd0-a12d-5b34-b508-80b1b87f1919 with identifier: KU93910 to the API
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:03:47Z',
 'fuel_type': 'hybrid',
 'id': '6f92dfd0-a12d-5b34-b508-80b1b87f1919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU93910',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 113693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 HDi Hybrid4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU93910%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Saving data for KU93910: {'auction_closing_time': 1774883027.0, 'created_time': 1774521579.9574, 'last_price_update_time': 1774722955.747755}
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU93910') HTTP/1.1" 204 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK24126%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for BK24126: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC39473%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for EC39473: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK25344%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for YK25344: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG59761%27 HTTP/1.1" 200 None
2026-03-28 18:35:55 [auto1.de] INFO: Scrape type for UG59761: 0
2026-03-28 18:35:55 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-28 18:35:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:56 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 6000 | hits on page: 40
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR07443%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for YR07443: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND18169%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for ND18169: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN93893%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for AN93893: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE74949%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for EE74949: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU92987%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for XU92987: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU36572%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for MU36572: 0
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-28 18:35:56 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-28 18:35:56 [auto1.de] INFO: Scrape type for AP20693: 2
2026-03-28 18:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f95bb6a8-e05a-5735-a145-4566bd28db91 with identifier: AP20693
2026-03-28 18:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f95bb6a8-e05a-5735-a145-4566bd28db91 with scrape type 2
2026-03-28 18:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f95bb6a8-e05a-5735-a145-4566bd28db91 with scrape type 2
2026-03-28 18:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f95bb6a8-e05a-5735-a145-4566bd28db91, identifier: AP20693
2026-03-28 18:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f95bb6a8-e05a-5735-a145-4566bd28db91 with identifier: AP20693
2026-03-28 18:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f95bb6a8-e05a-5735-a145-4566bd28db91 with identifier: AP20693
2026-03-28 18:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f95bb6a8-e05a-5735-a145-4566bd28db91 with identifier: AP20693 to the API
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:46Z',
 'fuel_type': 'diesel',
 'id': 'f95bb6a8-e05a-5735-a145-4566bd28db91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP20693',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 315705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-15',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 dCi 360 4x4',
 'transmission': 'automatic',
 'trim': '360 4x4',
 'year': 2013}
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP20693%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Saving data for AP20693: {'auction_closing_time': 1774883146.0, 'created_time': 1774522505.361843, 'last_price_update_time': 1774722957.295681}
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP20693') HTTP/1.1" 204 0
2026-03-28 18:35:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT56915%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for YT56915: 0
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX05177%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for VX05177: 0
2026-03-28 18:35:57 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-28 18:35:57 [auto1.de] INFO: Scrape type for ZK07522: 2
2026-03-28 18:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa7ae772-719a-5c6e-9c3f-c3f647a64180 with identifier: ZK07522
2026-03-28 18:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa7ae772-719a-5c6e-9c3f-c3f647a64180 with scrape type 2
2026-03-28 18:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa7ae772-719a-5c6e-9c3f-c3f647a64180 with scrape type 2
2026-03-28 18:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa7ae772-719a-5c6e-9c3f-c3f647a64180, identifier: ZK07522
2026-03-28 18:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa7ae772-719a-5c6e-9c3f-c3f647a64180 with identifier: ZK07522
2026-03-28 18:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa7ae772-719a-5c6e-9c3f-c3f647a64180 with identifier: ZK07522
2026-03-28 18:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa7ae772-719a-5c6e-9c3f-c3f647a64180 with identifier: ZK07522 to the API
2026-03-28 18:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-30T15:52:38Z',
 'fuel_type': 'petrol',
 'id': 'aa7ae772-719a-5c6e-9c3f-c3f647a64180',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK07522',
 'listing': 'auction',
 'make': 'Maserati',
 'model': 'Grecale',
 'odometer': 27730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-15',
 'seller_name': None,
 'title': 'Maserati Grecale 2.0 Turbo Mild-Hybrid Modena AWD',
 'transmission': 'automatic',
 'trim': 'Modena AWD',
 'year': 2023}
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK07522%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Saving data for ZK07522: {'auction_closing_time': 1774885958.0, 'created_time': 1774549854.128375, 'last_price_update_time': 1774722958.266863}
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK07522') HTTP/1.1" 204 0
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: US61717
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL91815%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Scrape type for JL91815: 0
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08144%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Scrape type for SG08144: 0
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ63993%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Scrape type for UJ63993: 0
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Scrape type for XP10598: 2
2026-03-28 18:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ed0f722-c06d-5659-8f0f-94074b18bed4 with identifier: XP10598
2026-03-28 18:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ed0f722-c06d-5659-8f0f-94074b18bed4 with scrape type 2
2026-03-28 18:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ed0f722-c06d-5659-8f0f-94074b18bed4 with scrape type 2
2026-03-28 18:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ed0f722-c06d-5659-8f0f-94074b18bed4, identifier: XP10598
2026-03-28 18:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ed0f722-c06d-5659-8f0f-94074b18bed4 with identifier: XP10598
2026-03-28 18:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ed0f722-c06d-5659-8f0f-94074b18bed4 with identifier: XP10598
2026-03-28 18:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ed0f722-c06d-5659-8f0f-94074b18bed4 with identifier: XP10598 to the API
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:26:17Z',
 'fuel_type': 'diesel',
 'id': '9ed0f722-c06d-5659-8f0f-94074b18bed4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP10598',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 278847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-22',
 'seller_name': None,
 'title': 'BMW 3er 330d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP10598%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Saving data for XP10598: {'auction_closing_time': 1774884377.0, 'created_time': 1774521834.637139, 'last_price_update_time': 1774722958.791616}
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP10598') HTTP/1.1" 204 0
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27093%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Scrape type for PJ27093: 0
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM49388%27 HTTP/1.1" 200 None
2026-03-28 18:35:58 [auto1.de] INFO: Scrape type for FM49388: 0
2026-03-28 18:35:58 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 18:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:35:59 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 6001 | hits on page: 40
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA76775%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for DA76775: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT48359%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for HT48359: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET45765%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for ET45765: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ86023%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for RZ86023: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX80532%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for RX80532: 0
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-28 18:35:59 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-28 18:35:59 [auto1.de] INFO: Scrape type for SB35470: 2
2026-03-28 18:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c257a53-690d-5983-be70-3bb3206b465b with identifier: SB35470
2026-03-28 18:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c257a53-690d-5983-be70-3bb3206b465b with scrape type 2
2026-03-28 18:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c257a53-690d-5983-be70-3bb3206b465b with scrape type 2
2026-03-28 18:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c257a53-690d-5983-be70-3bb3206b465b, identifier: SB35470
2026-03-28 18:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c257a53-690d-5983-be70-3bb3206b465b with identifier: SB35470
2026-03-28 18:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c257a53-690d-5983-be70-3bb3206b465b with identifier: SB35470
2026-03-28 18:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c257a53-690d-5983-be70-3bb3206b465b with identifier: SB35470 to the API
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:03:32Z',
 'fuel_type': 'diesel',
 'id': '4c257a53-690d-5983-be70-3bb3206b465b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB35470',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 48965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB35470%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Saving data for SB35470: {'auction_closing_time': 1774883012.0, 'created_time': 1772547044.289282, 'last_price_update_time': 1774722960.408981}
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB35470') HTTP/1.1" 204 0
2026-03-28 18:36:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF21072%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for UF21072: 0
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC98998%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for CC98998: 0
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS48010%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for XS48010: 0
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD74109%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for FD74109: 0
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD09657%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for YD09657: 0
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06043%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for VN06043: 0
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK89149%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for TK89149: 0
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK50877%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for XK50877: 0
2026-03-28 18:36:00 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-28 18:36:00 [auto1.de] INFO: Scrape type for TA61960: 2
2026-03-28 18:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9c68c09-7a77-5e6d-816e-fc12e1ade24e with identifier: TA61960
2026-03-28 18:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9c68c09-7a77-5e6d-816e-fc12e1ade24e with scrape type 2
2026-03-28 18:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9c68c09-7a77-5e6d-816e-fc12e1ade24e with scrape type 2
2026-03-28 18:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9c68c09-7a77-5e6d-816e-fc12e1ade24e, identifier: TA61960
2026-03-28 18:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9c68c09-7a77-5e6d-816e-fc12e1ade24e with identifier: TA61960
2026-03-28 18:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9c68c09-7a77-5e6d-816e-fc12e1ade24e with identifier: TA61960
2026-03-28 18:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9c68c09-7a77-5e6d-816e-fc12e1ade24e with identifier: TA61960 to the API
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:26Z',
 'fuel_type': 'diesel',
 'id': 'e9c68c09-7a77-5e6d-816e-fc12e1ade24e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA61960',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 183568,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA61960%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Saving data for TA61960: {'auction_closing_time': 1774883066.0, 'created_time': 1774522032.366457, 'last_price_update_time': 1774722961.154132}
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA61960') HTTP/1.1" 204 0
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV41920%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Scrape type for FV41920: 0
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH51780%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Scrape type for LH51780: 0
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX47002%27 HTTP/1.1" 200 None
2026-03-28 18:36:01 [auto1.de] INFO: Scrape type for UX47002: 0
2026-03-28 18:36:01 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-28 18:36:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:02 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP96351%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for XP96351: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM66386%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for TM66386: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL10604%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for WL10604: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92547%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for MV92547: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU77482%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for JU77482: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW72669%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for KW72669: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP93259%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for YP93259: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for SZ10404: 2
2026-03-28 18:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with identifier: SZ10404
2026-03-28 18:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with scrape type 2
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with scrape type 2
2026-03-28 18:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600, identifier: SZ10404
2026-03-28 18:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with identifier: SZ10404
2026-03-28 18:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with identifier: SZ10404
2026-03-28 18:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600 with identifier: SZ10404 to the API
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:11:24Z',
 'fuel_type': 'diesel',
 'id': '5fdd15c3-ef0e-56b5-a1ed-cdd2d04ef600',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ10404',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-02-11',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ10404%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Saving data for SZ10404: {'auction_closing_time': 1774883484.0, 'created_time': 1774032228.871473, 'last_price_update_time': 1774722962.834496}
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ10404') HTTP/1.1" 204 0
2026-03-28 18:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX47030%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for PX47030: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP37345%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for YP37345: 0
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-28 18:36:02 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-28 18:36:02 [auto1.de] INFO: Scrape type for MP44977: 2
2026-03-28 18:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with identifier: MP44977
2026-03-28 18:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with scrape type 2
2026-03-28 18:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with scrape type 2
2026-03-28 18:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece, identifier: MP44977
2026-03-28 18:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with identifier: MP44977
2026-03-28 18:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with identifier: MP44977
2026-03-28 18:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d9a6843-52b1-5b0e-bfaa-5d48c6442ece with identifier: MP44977 to the API
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:47:43Z',
 'fuel_type': 'diesel',
 'id': '1d9a6843-52b1-5b0e-bfaa-5d48c6442ece',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP44977',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 73553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 40 TDI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2020}
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP44977%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [auto1.de] INFO: Saving data for MP44977: {'auction_closing_time': 1774885663.0, 'created_time': 1774117859.982382, 'last_price_update_time': 1774722963.411814}
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP44977') HTTP/1.1" 204 0
2026-03-28 18:36:03 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE68759%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [auto1.de] INFO: Scrape type for CE68759: 0
2026-03-28 18:36:03 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR33954%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [auto1.de] INFO: Scrape type for AR33954: 0
2026-03-28 18:36:03 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-28 18:36:03 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-28 18:36:03 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-28 18:36:03 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-28 18:36:03 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-28 18:36:03 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [auto1.de] INFO: Scrape type for AW26108: 2
2026-03-28 18:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 398bde9e-315c-56fc-a56d-680a0aa4e7fa with identifier: AW26108
2026-03-28 18:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 398bde9e-315c-56fc-a56d-680a0aa4e7fa with scrape type 2
2026-03-28 18:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 398bde9e-315c-56fc-a56d-680a0aa4e7fa with scrape type 2
2026-03-28 18:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 398bde9e-315c-56fc-a56d-680a0aa4e7fa, identifier: AW26108
2026-03-28 18:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 398bde9e-315c-56fc-a56d-680a0aa4e7fa with identifier: AW26108
2026-03-28 18:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 398bde9e-315c-56fc-a56d-680a0aa4e7fa with identifier: AW26108
2026-03-28 18:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 398bde9e-315c-56fc-a56d-680a0aa4e7fa with identifier: AW26108 to the API
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:58:14Z',
 'fuel_type': 'diesel',
 'id': '398bde9e-315c-56fc-a56d-680a0aa4e7fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW26108',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 147562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-20',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26108%27 HTTP/1.1" 200 None
2026-03-28 18:36:03 [auto1.de] INFO: Saving data for AW26108: {'auction_closing_time': 1774886294.0, 'created_time': 1774089332.653136, 'last_price_update_time': 1774722963.910635}
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW26108') HTTP/1.1" 204 0
2026-03-28 18:36:04 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [auto1.de] INFO: Scrape type for LJ68235: 2
2026-03-28 18:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dfb657e-0ca6-5583-b866-b467b729d7ca with identifier: LJ68235
2026-03-28 18:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dfb657e-0ca6-5583-b866-b467b729d7ca with scrape type 2
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dfb657e-0ca6-5583-b866-b467b729d7ca with scrape type 2
2026-03-28 18:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dfb657e-0ca6-5583-b866-b467b729d7ca, identifier: LJ68235
2026-03-28 18:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dfb657e-0ca6-5583-b866-b467b729d7ca with identifier: LJ68235
2026-03-28 18:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dfb657e-0ca6-5583-b866-b467b729d7ca with identifier: LJ68235
2026-03-28 18:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dfb657e-0ca6-5583-b866-b467b729d7ca with identifier: LJ68235 to the API
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:38:44Z',
 'fuel_type': 'diesel',
 'id': '6dfb657e-0ca6-5583-b866-b467b729d7ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ68235',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 108505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-25',
 'seller_name': None,
 'title': 'Peugeot 208 1.4 HDi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2014}
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ68235%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [auto1.de] INFO: Saving data for LJ68235: {'auction_closing_time': 1774885124.0, 'created_time': 1774522008.677466, 'last_price_update_time': 1774722964.452125}
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ68235') HTTP/1.1" 204 0
2026-03-28 18:36:04 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70879%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [auto1.de] INFO: Scrape type for EE70879: 0
2026-03-28 18:36:04 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-28 18:36:04 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC74122%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [auto1.de] INFO: Scrape type for EC74122: 0
2026-03-28 18:36:04 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-28 18:36:04 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [auto1.de] INFO: Scrape type for WV19329: 2
2026-03-28 18:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd6390db-6343-5203-b9ae-707968dc0ea0 with identifier: WV19329
2026-03-28 18:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd6390db-6343-5203-b9ae-707968dc0ea0 with scrape type 2
2026-03-28 18:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd6390db-6343-5203-b9ae-707968dc0ea0 with scrape type 2
2026-03-28 18:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd6390db-6343-5203-b9ae-707968dc0ea0, identifier: WV19329
2026-03-28 18:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd6390db-6343-5203-b9ae-707968dc0ea0 with identifier: WV19329
2026-03-28 18:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd6390db-6343-5203-b9ae-707968dc0ea0 with identifier: WV19329
2026-03-28 18:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd6390db-6343-5203-b9ae-707968dc0ea0 with identifier: WV19329 to the API
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:13:21Z',
 'fuel_type': 'diesel',
 'id': 'bd6390db-6343-5203-b9ae-707968dc0ea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV19329',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 351077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV19329%27 HTTP/1.1" 200 None
2026-03-28 18:36:04 [auto1.de] INFO: Saving data for WV19329: {'auction_closing_time': 1774883601.0, 'created_time': 1773303613.39509, 'last_price_update_time': 1774722964.985736}
2026-03-28 18:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV19329') HTTP/1.1" 204 0
2026-03-28 18:36:05 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24569%27 HTTP/1.1" 200 None
2026-03-28 18:36:05 [auto1.de] INFO: Scrape type for KX24569: 0
2026-03-28 18:36:05 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-28 18:36:05 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ12041%27 HTTP/1.1" 200 None
2026-03-28 18:36:05 [auto1.de] INFO: Scrape type for EJ12041: 0
2026-03-28 18:36:05 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-28 18:36:05 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW55400%27 HTTP/1.1" 200 None
2026-03-28 18:36:05 [auto1.de] INFO: Scrape type for WW55400: 0
2026-03-28 18:36:05 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR66334%27 HTTP/1.1" 200 None
2026-03-28 18:36:05 [auto1.de] INFO: Scrape type for VR66334: 0
2026-03-28 18:36:05 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83154%27 HTTP/1.1" 200 None
2026-03-28 18:36:05 [auto1.de] INFO: Scrape type for KA83154: 0
2026-03-28 18:36:05 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-28 18:36:07 [scrapy.extensions.logstats] INFO: Crawled 144 pages (at 15 pages/min), scraped 349 items (at 43 items/min)
2026-03-28 18:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-28 18:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:36 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM50806%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for WM50806: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for EU38402: 2
2026-03-28 18:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 367e5e3f-8025-59cc-b512-cd2739e303b1 with identifier: EU38402
2026-03-28 18:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 367e5e3f-8025-59cc-b512-cd2739e303b1 with scrape type 2
2026-03-28 18:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 367e5e3f-8025-59cc-b512-cd2739e303b1 with scrape type 2
2026-03-28 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 367e5e3f-8025-59cc-b512-cd2739e303b1, identifier: EU38402
2026-03-28 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 367e5e3f-8025-59cc-b512-cd2739e303b1 with identifier: EU38402
2026-03-28 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 367e5e3f-8025-59cc-b512-cd2739e303b1 with identifier: EU38402
2026-03-28 18:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 367e5e3f-8025-59cc-b512-cd2739e303b1 with identifier: EU38402 to the API
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:00:42Z',
 'fuel_type': 'petrol',
 'id': '367e5e3f-8025-59cc-b512-cd2739e303b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU38402',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 64386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-21',
 'seller_name': None,
 'title': 'Renault Megane 1.2 Paris',
 'transmission': 'manual',
 'trim': 'Paris',
 'year': 2014}
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU38402%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Saving data for EU38402: {'auction_closing_time': 1774882842.0, 'created_time': 1774521614.803885, 'last_price_update_time': 1774722996.568269}
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU38402') HTTP/1.1" 204 0
2026-03-28 18:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86141%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for JB86141: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX41680%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for NX41680: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX24898%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for AX24898: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD44773%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for GD44773: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV00012%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for CV00012: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD76267%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for WD76267: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF46634%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for WF46634: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK74159%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for MK74159: 0
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-28 18:36:36 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-28 18:36:36 [auto1.de] INFO: Scrape type for JY20186: 2
2026-03-28 18:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-03-28 18:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccb5350a-8276-59c1-b328-a1679a181ac8 with scrape type 2
2026-03-28 18:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccb5350a-8276-59c1-b328-a1679a181ac8 with scrape type 2
2026-03-28 18:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccb5350a-8276-59c1-b328-a1679a181ac8, identifier: JY20186
2026-03-28 18:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-03-28 18:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186
2026-03-28 18:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccb5350a-8276-59c1-b328-a1679a181ac8 with identifier: JY20186 to the API
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:23:12Z',
 'fuel_type': 'petrol',
 'id': 'ccb5350a-8276-59c1-b328-a1679a181ac8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY20186',
 'listing': 'auction',
 'make': 'MG Rover',
 'model': 'MGF',
 'odometer': 90591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-11-13',
 'seller_name': None,
 'title': 'MG Rover MGF 1.8 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2000}
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20186%27 HTTP/1.1" 200 None
2026-03-28 18:36:37 [auto1.de] INFO: Saving data for JY20186: {'auction_closing_time': 1774884192.0, 'created_time': 1774521513.161552, 'last_price_update_time': 1774722997.955655}
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY20186') HTTP/1.1" 204 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA59135%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for FA59135: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV96832%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for BV96832: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for GJ77265: 2
2026-03-28 18:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with identifier: GJ77265
2026-03-28 18:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with scrape type 2
2026-03-28 18:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with scrape type 2
2026-03-28 18:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7, identifier: GJ77265
2026-03-28 18:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with identifier: GJ77265
2026-03-28 18:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with identifier: GJ77265
2026-03-28 18:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3046c5c0-5ff4-513f-87b3-7f52d44d5bb7 with identifier: GJ77265 to the API
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:28Z',
 'fuel_type': 'petrol',
 'id': '3046c5c0-5ff4-513f-87b3-7f52d44d5bb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ77265',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 16372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-17',
 'seller_name': None,
 'title': 'Opel Adam 1.2 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2013}
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ77265%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Saving data for GJ77265: {'auction_closing_time': 1774885528.0, 'created_time': 1774522023.113825, 'last_price_update_time': 1774722998.629276}
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ77265') HTTP/1.1" 204 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG82377%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for JG82377: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE81869%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for YE81869: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18365%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for BY18365: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX80624%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for FX80624: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS45422%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for PS45422: 0
2026-03-28 18:36:38 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-28 18:36:38 [auto1.de] INFO: Scrape type for GX75432: 2
2026-03-28 18:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3241154-3c4f-55b7-a05b-7a9db02c11ab with identifier: GX75432
2026-03-28 18:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3241154-3c4f-55b7-a05b-7a9db02c11ab with scrape type 2
2026-03-28 18:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3241154-3c4f-55b7-a05b-7a9db02c11ab with scrape type 2
2026-03-28 18:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3241154-3c4f-55b7-a05b-7a9db02c11ab, identifier: GX75432
2026-03-28 18:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3241154-3c4f-55b7-a05b-7a9db02c11ab with identifier: GX75432
2026-03-28 18:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3241154-3c4f-55b7-a05b-7a9db02c11ab with identifier: GX75432
2026-03-28 18:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3241154-3c4f-55b7-a05b-7a9db02c11ab with identifier: GX75432 to the API
2026-03-28 18:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:41:08Z',
 'fuel_type': 'petrol',
 'id': 'f3241154-3c4f-55b7-a05b-7a9db02c11ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX75432',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 95465,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-25',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis Prime',
 'transmission': 'automatic',
 'trim': 'Basis Prime',
 'year': 2018}
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX75432%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Saving data for GX75432: {'auction_closing_time': 1774885268.0, 'created_time': 1774522571.130744, 'last_price_update_time': 1774722999.178464}
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX75432') HTTP/1.1" 204 0
2026-03-28 18:36:39 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC63279%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Scrape type for WC63279: 0
2026-03-28 18:36:39 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Scrape type for YA96721: 2
2026-03-28 18:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with identifier: YA96721
2026-03-28 18:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with scrape type 2
2026-03-28 18:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with scrape type 2
2026-03-28 18:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af68b64e-d440-5c50-8b6a-a33f6f8c29c2, identifier: YA96721
2026-03-28 18:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with identifier: YA96721
2026-03-28 18:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with identifier: YA96721
2026-03-28 18:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af68b64e-d440-5c50-8b6a-a33f6f8c29c2 with identifier: YA96721 to the API
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:09:40Z',
 'fuel_type': 'diesel',
 'id': 'af68b64e-d440-5c50-8b6a-a33f6f8c29c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA96721',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 166419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-30',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA96721%27 HTTP/1.1" 200 None
2026-03-28 18:36:39 [auto1.de] INFO: Saving data for YA96721: {'auction_closing_time': 1774883380.0, 'created_time': 1774550022.14355, 'last_price_update_time': 1774722999.801239}
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA96721') HTTP/1.1" 204 0
2026-03-28 18:36:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:40 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:40 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-28 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-28 18:36:40 [auto1.de] INFO: Scrape type for EJ52813: 2
2026-03-28 18:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0ce38ba-56b2-5717-8e1e-435664f98629 with identifier: EJ52813
2026-03-28 18:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0ce38ba-56b2-5717-8e1e-435664f98629 with scrape type 2
2026-03-28 18:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0ce38ba-56b2-5717-8e1e-435664f98629 with scrape type 2
2026-03-28 18:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0ce38ba-56b2-5717-8e1e-435664f98629, identifier: EJ52813
2026-03-28 18:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0ce38ba-56b2-5717-8e1e-435664f98629 with identifier: EJ52813
2026-03-28 18:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0ce38ba-56b2-5717-8e1e-435664f98629 with identifier: EJ52813
2026-03-28 18:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0ce38ba-56b2-5717-8e1e-435664f98629 with identifier: EJ52813 to the API
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:14:50Z',
 'fuel_type': 'petrol',
 'id': 'a0ce38ba-56b2-5717-8e1e-435664f98629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ52813',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 30142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ52813%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Saving data for EJ52813: {'auction_closing_time': 1774883690.0, 'created_time': 1773429030.880557, 'last_price_update_time': 1774723001.302006}
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ52813') HTTP/1.1" 204 0
2026-03-28 18:36:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM45973%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for GM45973: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU33144%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for TU33144: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX52940%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for BX52940: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE80644%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for CE80644: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX52884%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for SX52884: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV05301%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for RV05301: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54610%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for HH54610: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE87881%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for GE87881: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL02906%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for BL02906: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW79477%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for WW79477: 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Scrape type for ZY60733: 2
2026-03-28 18:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef912cf3-25f3-590a-9145-0c863fbb96ed with identifier: ZY60733
2026-03-28 18:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef912cf3-25f3-590a-9145-0c863fbb96ed with scrape type 2
2026-03-28 18:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef912cf3-25f3-590a-9145-0c863fbb96ed with scrape type 2
2026-03-28 18:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef912cf3-25f3-590a-9145-0c863fbb96ed, identifier: ZY60733
2026-03-28 18:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef912cf3-25f3-590a-9145-0c863fbb96ed with identifier: ZY60733
2026-03-28 18:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef912cf3-25f3-590a-9145-0c863fbb96ed with identifier: ZY60733
2026-03-28 18:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef912cf3-25f3-590a-9145-0c863fbb96ed with identifier: ZY60733 to the API
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:15:36Z',
 'fuel_type': 'petrol',
 'id': 'ef912cf3-25f3-590a-9145-0c863fbb96ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY60733',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 132793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-12',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2014}
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY60733%27 HTTP/1.1" 200 None
2026-03-28 18:36:41 [auto1.de] INFO: Saving data for ZY60733: {'auction_closing_time': 1774883736.0, 'created_time': 1774636477.082943, 'last_price_update_time': 1774723001.887461}
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY60733') HTTP/1.1" 204 0
2026-03-28 18:36:41 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for MU06358: 2
2026-03-28 18:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e13031e2-25fe-5d9b-b630-da83a3035d19 with identifier: MU06358
2026-03-28 18:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e13031e2-25fe-5d9b-b630-da83a3035d19 with scrape type 2
2026-03-28 18:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e13031e2-25fe-5d9b-b630-da83a3035d19 with scrape type 2
2026-03-28 18:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e13031e2-25fe-5d9b-b630-da83a3035d19, identifier: MU06358
2026-03-28 18:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e13031e2-25fe-5d9b-b630-da83a3035d19 with identifier: MU06358
2026-03-28 18:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e13031e2-25fe-5d9b-b630-da83a3035d19 with identifier: MU06358
2026-03-28 18:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e13031e2-25fe-5d9b-b630-da83a3035d19 with identifier: MU06358 to the API
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:36:51Z',
 'fuel_type': 'petrol',
 'id': 'e13031e2-25fe-5d9b-b630-da83a3035d19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU06358',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 147417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-06',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2013}
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU06358%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Saving data for MU06358: {'auction_closing_time': 1774885011.0, 'created_time': 1774636344.503339, 'last_price_update_time': 1774723002.402958}
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU06358') HTTP/1.1" 204 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK32978%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for GK32978: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH74073%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for GH74073: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC93569%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for LC93569: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ84301%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for XJ84301: 0
2026-03-28 18:36:42 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Scrape type for VW88901: 2
2026-03-28 18:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 734623e2-60ec-5290-98cb-68d04e7eb2f0 with identifier: VW88901
2026-03-28 18:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 734623e2-60ec-5290-98cb-68d04e7eb2f0 with scrape type 2
2026-03-28 18:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 734623e2-60ec-5290-98cb-68d04e7eb2f0 with scrape type 2
2026-03-28 18:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 734623e2-60ec-5290-98cb-68d04e7eb2f0, identifier: VW88901
2026-03-28 18:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 734623e2-60ec-5290-98cb-68d04e7eb2f0 with identifier: VW88901
2026-03-28 18:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 734623e2-60ec-5290-98cb-68d04e7eb2f0 with identifier: VW88901
2026-03-28 18:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 734623e2-60ec-5290-98cb-68d04e7eb2f0 with identifier: VW88901 to the API
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:36Z',
 'fuel_type': 'petrol',
 'id': '734623e2-60ec-5290-98cb-68d04e7eb2f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW88901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 28181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-12',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2023}
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW88901%27 HTTP/1.1" 200 None
2026-03-28 18:36:42 [auto1.de] INFO: Saving data for VW88901: {'auction_closing_time': 1774884996.0, 'created_time': 1774033867.114763, 'last_price_update_time': 1774723002.914255}
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW88901') HTTP/1.1" 204 0
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-28 18:36:43 [auto1.de] INFO: Scrape type for GC49390: 2
2026-03-28 18:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with identifier: GC49390
2026-03-28 18:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with scrape type 2
2026-03-28 18:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with scrape type 2
2026-03-28 18:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e, identifier: GC49390
2026-03-28 18:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with identifier: GC49390
2026-03-28 18:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with identifier: GC49390
2026-03-28 18:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74bf406a-3d7b-532a-9d1e-3cf9e6bad79e with identifier: GC49390 to the API
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 154,
 'expiration_date': '2026-03-30T15:29:04Z',
 'fuel_type': 'petrol',
 'id': '74bf406a-3d7b-532a-9d1e-3cf9e6bad79e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC49390',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 80905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-22',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Edition One',
 'transmission': 'automatic',
 'trim': 'Edition One',
 'year': 2020}
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC49390%27 HTTP/1.1" 200 None
2026-03-28 18:36:43 [auto1.de] INFO: Saving data for GC49390: {'auction_closing_time': 1774884544.0, 'created_time': 1774636536.221248, 'last_price_update_time': 1774723003.465142}
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC49390') HTTP/1.1" 204 0
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10933%27 HTTP/1.1" 200 None
2026-03-28 18:36:43 [auto1.de] INFO: Scrape type for DK10933: 0
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY38898%27 HTTP/1.1" 200 None
2026-03-28 18:36:43 [auto1.de] INFO: Scrape type for ZY38898: 0
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-28 18:36:43 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-28 18:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:44 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF79557%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for WF79557: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS34798%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for JS34798: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT07076%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for TT07076: 0
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for UW42720: 2
2026-03-28 18:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3923db3-539e-52cb-980f-208a13f8cb89 with identifier: UW42720
2026-03-28 18:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3923db3-539e-52cb-980f-208a13f8cb89 with scrape type 2
2026-03-28 18:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3923db3-539e-52cb-980f-208a13f8cb89 with scrape type 2
2026-03-28 18:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3923db3-539e-52cb-980f-208a13f8cb89, identifier: UW42720
2026-03-28 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3923db3-539e-52cb-980f-208a13f8cb89 with identifier: UW42720
2026-03-28 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3923db3-539e-52cb-980f-208a13f8cb89 with identifier: UW42720
2026-03-28 18:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3923db3-539e-52cb-980f-208a13f8cb89 with identifier: UW42720 to the API
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:07:58Z',
 'fuel_type': 'petrol',
 'id': 'e3923db3-539e-52cb-980f-208a13f8cb89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW42720',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 81535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-18',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2011}
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW42720%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Saving data for UW42720: {'auction_closing_time': 1774883278.0, 'created_time': 1774032341.577132, 'last_price_update_time': 1774723004.619371}
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW42720') HTTP/1.1" 204 0
2026-03-28 18:36:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-28 18:36:44 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-28 18:36:44 [auto1.de] INFO: Scrape type for MX86281: 2
2026-03-28 18:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7a5259f-d720-55e2-b188-398a5d3c2f51 with identifier: MX86281
2026-03-28 18:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7a5259f-d720-55e2-b188-398a5d3c2f51 with scrape type 2
2026-03-28 18:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7a5259f-d720-55e2-b188-398a5d3c2f51 with scrape type 2
2026-03-28 18:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7a5259f-d720-55e2-b188-398a5d3c2f51, identifier: MX86281
2026-03-28 18:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7a5259f-d720-55e2-b188-398a5d3c2f51 with identifier: MX86281
2026-03-28 18:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7a5259f-d720-55e2-b188-398a5d3c2f51 with identifier: MX86281
2026-03-28 18:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7a5259f-d720-55e2-b188-398a5d3c2f51 with identifier: MX86281 to the API
2026-03-28 18:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:24:32Z',
 'fuel_type': 'petrol',
 'id': 'b7a5259f-d720-55e2-b188-398a5d3c2f51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX86281',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 50809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-10',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX86281%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Saving data for MX86281: {'auction_closing_time': 1774884272.0, 'created_time': 1774522135.06888, 'last_price_update_time': 1774723005.150677}
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX86281') HTTP/1.1" 204 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV48270%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for NV48270: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65369%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for CA65369: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD28198%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for SD28198: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: US56502
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US56502%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for US56502: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ83217%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for UJ83217: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW30650%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for HW30650: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX41369%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for WX41369: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ36407%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for GJ36407: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME64315%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for ME64315: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF72599%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for YF72599: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK89074%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for DK89074: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA79718%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for ZA79718: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY50059%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for SY50059: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF62684%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for FF62684: 0
2026-03-28 18:36:45 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Scrape type for MN48285: 2
2026-03-28 18:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad054cd1-62a1-5d06-a4b6-e136f1036163 with identifier: MN48285
2026-03-28 18:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad054cd1-62a1-5d06-a4b6-e136f1036163 with scrape type 2
2026-03-28 18:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad054cd1-62a1-5d06-a4b6-e136f1036163 with scrape type 2
2026-03-28 18:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad054cd1-62a1-5d06-a4b6-e136f1036163, identifier: MN48285
2026-03-28 18:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad054cd1-62a1-5d06-a4b6-e136f1036163 with identifier: MN48285
2026-03-28 18:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad054cd1-62a1-5d06-a4b6-e136f1036163 with identifier: MN48285
2026-03-28 18:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad054cd1-62a1-5d06-a4b6-e136f1036163 with identifier: MN48285 to the API
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:40:14Z',
 'fuel_type': 'petrol',
 'id': 'ad054cd1-62a1-5d06-a4b6-e136f1036163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN48285',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 24838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-21',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN48285%27 HTTP/1.1" 200 None
2026-03-28 18:36:45 [auto1.de] INFO: Saving data for MN48285: {'auction_closing_time': 1774885214.0, 'created_time': 1774118869.985095, 'last_price_update_time': 1774723005.827498}
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN48285') HTTP/1.1" 204 0
2026-03-28 18:36:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:46 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP24406%27 HTTP/1.1" 200 None
2026-03-28 18:36:46 [auto1.de] INFO: Scrape type for PP24406: 0
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM50450%27 HTTP/1.1" 200 None
2026-03-28 18:36:46 [auto1.de] INFO: Scrape type for FM50450: 0
2026-03-28 18:36:46 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-28 18:36:46 [auto1.de] INFO: Scrape type for MZ72093: 2
2026-03-28 18:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd932ac-a650-5134-891f-2570af428783 with identifier: MZ72093
2026-03-28 18:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd932ac-a650-5134-891f-2570af428783 with scrape type 2
2026-03-28 18:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd932ac-a650-5134-891f-2570af428783 with scrape type 2
2026-03-28 18:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffd932ac-a650-5134-891f-2570af428783, identifier: MZ72093
2026-03-28 18:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffd932ac-a650-5134-891f-2570af428783 with identifier: MZ72093
2026-03-28 18:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffd932ac-a650-5134-891f-2570af428783 with identifier: MZ72093
2026-03-28 18:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffd932ac-a650-5134-891f-2570af428783 with identifier: MZ72093 to the API
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:28Z',
 'fuel_type': 'diesel',
 'id': 'ffd932ac-a650-5134-891f-2570af428783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ72093',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 218488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-13',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ72093%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Saving data for MZ72093: {'auction_closing_time': 1774883368.0, 'created_time': 1774636304.219324, 'last_price_update_time': 1774723007.311101}
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ72093') HTTP/1.1" 204 0
2026-03-28 18:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77095%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for TB77095: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71363%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for HL71363: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB40017%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for YB40017: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: US92808
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US92808%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for US92808: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ89308%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for FZ89308: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG17640%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for SG17640: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP12091%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for HP12091: 0
2026-03-28 18:36:47 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Scrape type for WW27642: 2
2026-03-28 18:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51543cbd-6818-59ad-b179-5923b3e80ac4 with identifier: WW27642
2026-03-28 18:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51543cbd-6818-59ad-b179-5923b3e80ac4 with scrape type 2
2026-03-28 18:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51543cbd-6818-59ad-b179-5923b3e80ac4 with scrape type 2
2026-03-28 18:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51543cbd-6818-59ad-b179-5923b3e80ac4, identifier: WW27642
2026-03-28 18:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51543cbd-6818-59ad-b179-5923b3e80ac4 with identifier: WW27642
2026-03-28 18:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51543cbd-6818-59ad-b179-5923b3e80ac4 with identifier: WW27642
2026-03-28 18:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51543cbd-6818-59ad-b179-5923b3e80ac4 with identifier: WW27642 to the API
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:41Z',
 'fuel_type': 'diesel',
 'id': '51543cbd-6818-59ad-b179-5923b3e80ac4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW27642',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 401344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-31',
 'seller_name': None,
 'title': 'Volvo V50 2.0 D3 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2012}
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27642%27 HTTP/1.1" 200 None
2026-03-28 18:36:47 [auto1.de] INFO: Saving data for WW27642: {'auction_closing_time': 1774885961.0, 'created_time': 1773402631.432604, 'last_price_update_time': 1774723007.892551}
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW27642') HTTP/1.1" 204 0
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Scrape type for JC18235: 2
2026-03-28 18:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88ca809-2852-5afb-b963-f5e0ce351df4 with identifier: JC18235
2026-03-28 18:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88ca809-2852-5afb-b963-f5e0ce351df4 with scrape type 2
2026-03-28 18:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88ca809-2852-5afb-b963-f5e0ce351df4 with scrape type 2
2026-03-28 18:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88ca809-2852-5afb-b963-f5e0ce351df4, identifier: JC18235
2026-03-28 18:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88ca809-2852-5afb-b963-f5e0ce351df4 with identifier: JC18235
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 18:36:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88ca809-2852-5afb-b963-f5e0ce351df4 with identifier: JC18235
2026-03-28 18:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88ca809-2852-5afb-b963-f5e0ce351df4 with identifier: JC18235 to the API
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:10:49Z',
 'fuel_type': 'diesel',
 'id': 'e88ca809-2852-5afb-b963-f5e0ce351df4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC18235',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 154106,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-30',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDE FT 300 Kurz',
 'transmission': 'manual',
 'trim': 'FT 300 Kurz',
 'year': 2004}
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC18235%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Saving data for JC18235: {'auction_closing_time': 1774883449.0, 'created_time': 1774522280.986612, 'last_price_update_time': 1774723008.565811}
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC18235') HTTP/1.1" 204 0
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS52276%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Scrape type for RS52276: 0
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY51453%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Scrape type for EY51453: 0
2026-03-28 18:36:48 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-28 18:36:48 [auto1.de] INFO: Scrape type for SM51050: 2
2026-03-28 18:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 879cd69e-6018-5cec-839c-86b90860c660 with identifier: SM51050
2026-03-28 18:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 879cd69e-6018-5cec-839c-86b90860c660 with scrape type 2
2026-03-28 18:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 879cd69e-6018-5cec-839c-86b90860c660 with scrape type 2
2026-03-28 18:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 879cd69e-6018-5cec-839c-86b90860c660, identifier: SM51050
2026-03-28 18:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 879cd69e-6018-5cec-839c-86b90860c660 with identifier: SM51050
2026-03-28 18:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 879cd69e-6018-5cec-839c-86b90860c660 with identifier: SM51050
2026-03-28 18:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 879cd69e-6018-5cec-839c-86b90860c660 with identifier: SM51050 to the API
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:38Z',
 'fuel_type': 'diesel',
 'id': '879cd69e-6018-5cec-839c-86b90860c660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM51050',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 222193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2015}
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM51050%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Saving data for SM51050: {'auction_closing_time': 1774884038.0, 'created_time': 1774521347.413869, 'last_price_update_time': 1774723009.023398}
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM51050') HTTP/1.1" 204 0
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02075%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for SJ02075: 0
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37620%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for JV37620: 0
2026-03-28 18:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:49 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE90964%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for UE90964: 0
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ60236%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for KJ60236: 0
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT88605%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for NT88605: 0
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-28 18:36:49 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-28 18:36:49 [auto1.de] INFO: Scrape type for JG45711: 2
2026-03-28 18:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with identifier: JG45711
2026-03-28 18:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with scrape type 2
2026-03-28 18:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with scrape type 2
2026-03-28 18:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8, identifier: JG45711
2026-03-28 18:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with identifier: JG45711
2026-03-28 18:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with identifier: JG45711
2026-03-28 18:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 046527bb-f8cc-54ae-9dab-cfb21ba8abb8 with identifier: JG45711 to the API
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:59:21Z',
 'fuel_type': 'diesel',
 'id': '046527bb-f8cc-54ae-9dab-cfb21ba8abb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG45711',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 119132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-24',
 'seller_name': None,
 'title': 'Fiat Ducato 2.2 JTD 100',
 'transmission': 'manual',
 'trim': '100',
 'year': 2008}
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG45711%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Saving data for JG45711: {'auction_closing_time': 1774886361.0, 'created_time': 1773991278.76183, 'last_price_update_time': 1774723010.434986}
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG45711') HTTP/1.1" 204 0
2026-03-28 18:36:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for LH30739: 2
2026-03-28 18:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with identifier: LH30739
2026-03-28 18:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with scrape type 2
2026-03-28 18:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with scrape type 2
2026-03-28 18:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55, identifier: LH30739
2026-03-28 18:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with identifier: LH30739
2026-03-28 18:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with identifier: LH30739
2026-03-28 18:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92fce3e4-2fd1-5e43-bba4-773faf4c8b55 with identifier: LH30739 to the API
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:47:52Z',
 'fuel_type': 'diesel',
 'id': '92fce3e4-2fd1-5e43-bba4-773faf4c8b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH30739',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 122455,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-17',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Momentum Pro AWD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro AWD',
 'year': 2019}
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH30739%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Saving data for LH30739: {'auction_closing_time': 1774885672.0, 'created_time': 1774522376.357835, 'last_price_update_time': 1774723010.957124}
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH30739') HTTP/1.1" 204 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS48459%27 HTTP/1.1" 200 None
2026-03-28 18:36:50 [auto1.de] INFO: Scrape type for WS48459: 0
2026-03-28 18:36:50 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY09817%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for NY09817: 0
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC38320%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for EC38320: 0
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for PC42452: 2
2026-03-28 18:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7990960-29d4-5cc7-81ec-de117496537c with identifier: PC42452
2026-03-28 18:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7990960-29d4-5cc7-81ec-de117496537c with scrape type 2
2026-03-28 18:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7990960-29d4-5cc7-81ec-de117496537c with scrape type 2
2026-03-28 18:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7990960-29d4-5cc7-81ec-de117496537c, identifier: PC42452
2026-03-28 18:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7990960-29d4-5cc7-81ec-de117496537c with identifier: PC42452
2026-03-28 18:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7990960-29d4-5cc7-81ec-de117496537c with identifier: PC42452
2026-03-28 18:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7990960-29d4-5cc7-81ec-de117496537c with identifier: PC42452 to the API
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:49:21Z',
 'fuel_type': 'petrol',
 'id': 'f7990960-29d4-5cc7-81ec-de117496537c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC42452',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 67792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-28',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42452%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Saving data for PC42452: {'auction_closing_time': 1774885761.0, 'created_time': 1774349388.445346, 'last_price_update_time': 1774723011.454162}
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC42452') HTTP/1.1" 204 0
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP54088%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for DP54088: 0
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL69510%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for TL69510: 0
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN32134%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for XN32134: 0
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-28 18:36:51 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Scrape type for YH26863: 2
2026-03-28 18:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8edb4f8-105f-5624-9893-056650b72f2b with identifier: YH26863
2026-03-28 18:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8edb4f8-105f-5624-9893-056650b72f2b with scrape type 2
2026-03-28 18:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8edb4f8-105f-5624-9893-056650b72f2b with scrape type 2
2026-03-28 18:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8edb4f8-105f-5624-9893-056650b72f2b, identifier: YH26863
2026-03-28 18:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8edb4f8-105f-5624-9893-056650b72f2b with identifier: YH26863
2026-03-28 18:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8edb4f8-105f-5624-9893-056650b72f2b with identifier: YH26863
2026-03-28 18:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8edb4f8-105f-5624-9893-056650b72f2b with identifier: YH26863 to the API
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:57:41Z',
 'fuel_type': 'petrol',
 'id': 'e8edb4f8-105f-5624-9893-056650b72f2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH26863',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 113386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-07',
 'seller_name': None,
 'title': 'Ford S-Max 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH26863%27 HTTP/1.1" 200 None
2026-03-28 18:36:51 [auto1.de] INFO: Saving data for YH26863: {'auction_closing_time': 1774886261.0, 'created_time': 1773402357.088851, 'last_price_update_time': 1774723011.994561}
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH26863') HTTP/1.1" 204 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DH72575%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for DH72575: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP40831%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for UP40831: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER69054%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for ER69054: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV84583%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for NV84583: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA30893%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for TA30893: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY98084%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for UY98084: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-28 18:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:52 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY46967%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for FY46967: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB38942%27 HTTP/1.1" 200 None
2026-03-28 18:36:52 [auto1.de] INFO: Scrape type for WB38942: 0
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-28 18:36:52 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR98326%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for LR98326: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50752%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for XS50752: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU96107%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for DU96107: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for RA28686: 2
2026-03-28 18:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 574becf0-b859-54ae-96da-b2709a867805 with identifier: RA28686
2026-03-28 18:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 574becf0-b859-54ae-96da-b2709a867805 with scrape type 2
2026-03-28 18:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 574becf0-b859-54ae-96da-b2709a867805 with scrape type 2
2026-03-28 18:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 574becf0-b859-54ae-96da-b2709a867805, identifier: RA28686
2026-03-28 18:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 574becf0-b859-54ae-96da-b2709a867805 with identifier: RA28686
2026-03-28 18:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 574becf0-b859-54ae-96da-b2709a867805 with identifier: RA28686
2026-03-28 18:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 574becf0-b859-54ae-96da-b2709a867805 with identifier: RA28686 to the API
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:30Z',
 'fuel_type': 'diesel',
 'id': '574becf0-b859-54ae-96da-b2709a867805',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RA28686',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 234099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-18',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2014}
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA28686%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Saving data for RA28686: {'auction_closing_time': 1774885650.0, 'created_time': 1773427134.557706, 'last_price_update_time': 1774723013.491436}
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RA28686') HTTP/1.1" 204 0
2026-03-28 18:36:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL89727%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for PL89727: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD34588%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for WD34588: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW90276%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for DW90276: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH04951%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for TH04951: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM57013%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for YM57013: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA17642%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for UA17642: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA13082%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for GA13082: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68072%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for DR68072: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF57163%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for TF57163: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF61357%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for BF61357: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX15527%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for GX15527: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH34813%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for MH34813: 0
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-28 18:36:53 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY70185%27 HTTP/1.1" 200 None
2026-03-28 18:36:53 [auto1.de] INFO: Scrape type for XY70185: 0
2026-03-28 18:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:54 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 6001 | hits on page: 40
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP67164%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for LP67164: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY99054%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for MY99054: 0
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-28 18:36:54 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-28 18:36:54 [auto1.de] INFO: Scrape type for ZF64276: 2
2026-03-28 18:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a45055d-84d7-5467-9f23-59e3a60e9d42 with identifier: ZF64276
2026-03-28 18:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a45055d-84d7-5467-9f23-59e3a60e9d42 with scrape type 2
2026-03-28 18:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a45055d-84d7-5467-9f23-59e3a60e9d42 with scrape type 2
2026-03-28 18:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a45055d-84d7-5467-9f23-59e3a60e9d42, identifier: ZF64276
2026-03-28 18:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a45055d-84d7-5467-9f23-59e3a60e9d42 with identifier: ZF64276
2026-03-28 18:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a45055d-84d7-5467-9f23-59e3a60e9d42 with identifier: ZF64276
2026-03-28 18:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a45055d-84d7-5467-9f23-59e3a60e9d42 with identifier: ZF64276 to the API
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:30:00Z',
 'fuel_type': 'petrol',
 'id': '5a45055d-84d7-5467-9f23-59e3a60e9d42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF64276',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 161794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'BMW 1er 114i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF64276%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Saving data for ZF64276: {'auction_closing_time': 1774884600.0, 'created_time': 1773945097.385173, 'last_price_update_time': 1774723015.357212}
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF64276') HTTP/1.1" 204 0
2026-03-28 18:36:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH67229%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Scrape type for VH67229: 0
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF45027%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Scrape type for MF45027: 0
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU39152%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Scrape type for BU39152: 0
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13181%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Scrape type for NV13181: 0
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-28 18:36:55 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Scrape type for NF91917: 2
2026-03-28 18:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dec23b6c-c607-5770-91a4-69c613a59e00 with identifier: NF91917
2026-03-28 18:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dec23b6c-c607-5770-91a4-69c613a59e00 with scrape type 2
2026-03-28 18:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dec23b6c-c607-5770-91a4-69c613a59e00 with scrape type 2
2026-03-28 18:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dec23b6c-c607-5770-91a4-69c613a59e00, identifier: NF91917
2026-03-28 18:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dec23b6c-c607-5770-91a4-69c613a59e00 with identifier: NF91917
2026-03-28 18:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dec23b6c-c607-5770-91a4-69c613a59e00 with identifier: NF91917
2026-03-28 18:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dec23b6c-c607-5770-91a4-69c613a59e00 with identifier: NF91917 to the API
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:08:07Z',
 'fuel_type': 'petrol',
 'id': 'dec23b6c-c607-5770-91a4-69c613a59e00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF91917',
 'listing': 'auction',
 'make': 'Abarth',
 'model': '595',
 'odometer': 43521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Abarth 595 1.4 Competizione',
 'transmission': 'manual',
 'trim': 'Competizione',
 'year': 2019}
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF91917%27 HTTP/1.1" 200 None
2026-03-28 18:36:55 [auto1.de] INFO: Saving data for NF91917: {'auction_closing_time': 1774883287.0, 'created_time': 1773946318.794077, 'last_price_update_time': 1774723015.99779}
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF91917') HTTP/1.1" 204 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU76386%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for BU76386: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS69855%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for WS69855: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49418%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for TB49418: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD76793%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for JD76793: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for TW80485: 2
2026-03-28 18:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69eca622-3dd1-5870-a434-95dfb505d9f0 with identifier: TW80485
2026-03-28 18:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69eca622-3dd1-5870-a434-95dfb505d9f0 with scrape type 2
2026-03-28 18:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69eca622-3dd1-5870-a434-95dfb505d9f0 with scrape type 2
2026-03-28 18:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69eca622-3dd1-5870-a434-95dfb505d9f0, identifier: TW80485
2026-03-28 18:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69eca622-3dd1-5870-a434-95dfb505d9f0 with identifier: TW80485
2026-03-28 18:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69eca622-3dd1-5870-a434-95dfb505d9f0 with identifier: TW80485
2026-03-28 18:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69eca622-3dd1-5870-a434-95dfb505d9f0 with identifier: TW80485 to the API
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:50Z',
 'fuel_type': 'petrol',
 'id': '69eca622-3dd1-5870-a434-95dfb505d9f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW80485',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 186557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-28',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW80485%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Saving data for TW80485: {'auction_closing_time': 1774886390.0, 'created_time': 1774521674.178073, 'last_price_update_time': 1774723016.672768}
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW80485') HTTP/1.1" 204 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY10898%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for TY10898: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ00942%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for TZ00942: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT36384%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for KT36384: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV64166%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for ZV64166: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP38579%27 HTTP/1.1" 200 None
2026-03-28 18:36:56 [auto1.de] INFO: Scrape type for EP38579: 0
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-28 18:36:56 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-28 18:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:36:57 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 6002 | hits on page: 40
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE21884%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Scrape type for AE21884: 0
2026-03-28 18:36:57 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-28 18:36:57 [auto1.de] INFO: Scrape type for ZJ64916: 2
2026-03-28 18:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76d6ab45-cfab-5b41-948c-057f560d0c86 with identifier: ZJ64916
2026-03-28 18:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76d6ab45-cfab-5b41-948c-057f560d0c86 with scrape type 2
2026-03-28 18:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76d6ab45-cfab-5b41-948c-057f560d0c86 with scrape type 2
2026-03-28 18:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76d6ab45-cfab-5b41-948c-057f560d0c86, identifier: ZJ64916
2026-03-28 18:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76d6ab45-cfab-5b41-948c-057f560d0c86 with identifier: ZJ64916
2026-03-28 18:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76d6ab45-cfab-5b41-948c-057f560d0c86 with identifier: ZJ64916
2026-03-28 18:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76d6ab45-cfab-5b41-948c-057f560d0c86 with identifier: ZJ64916 to the API
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:22:04Z',
 'fuel_type': 'petrol',
 'id': '76d6ab45-cfab-5b41-948c-057f560d0c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ64916',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 227875,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-30',
 'seller_name': None,
 'title': 'Mazda 5 2.0 Top',
 'transmission': 'manual',
 'trim': 'Top',
 'year': 2008}
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ64916%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Saving data for ZJ64916: {'auction_closing_time': 1774884124.0, 'created_time': 1774033101.742341, 'last_price_update_time': 1774723018.048986}
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ64916') HTTP/1.1" 204 0
2026-03-28 18:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU12915%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for FU12915: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU81814%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for BU81814: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT92712%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for WT92712: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for HP00850: 2
2026-03-28 18:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49a94208-46b8-5a42-a383-e64a557f228c with identifier: HP00850
2026-03-28 18:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49a94208-46b8-5a42-a383-e64a557f228c with scrape type 2
2026-03-28 18:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49a94208-46b8-5a42-a383-e64a557f228c with scrape type 2
2026-03-28 18:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 49a94208-46b8-5a42-a383-e64a557f228c, identifier: HP00850
2026-03-28 18:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 49a94208-46b8-5a42-a383-e64a557f228c with identifier: HP00850
2026-03-28 18:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 49a94208-46b8-5a42-a383-e64a557f228c with identifier: HP00850
2026-03-28 18:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 49a94208-46b8-5a42-a383-e64a557f228c with identifier: HP00850 to the API
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:49:11Z',
 'fuel_type': 'petrol',
 'id': '49a94208-46b8-5a42-a383-e64a557f228c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP00850',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 240462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-11',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP00850%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Saving data for HP00850: {'auction_closing_time': 1774885751.0, 'created_time': 1774521303.322181, 'last_price_update_time': 1774723018.625201}
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP00850') HTTP/1.1" 204 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU65331%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for JU65331: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ73657%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for WJ73657: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81331%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for DK81331: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL30155%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for ZL30155: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG14891%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for ZG14891: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ09497%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for RZ09497: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG89012%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for GG89012: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF01905%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for LF01905: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44839%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for TW44839: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ17280%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for UJ17280: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX12921%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for YX12921: 0
2026-03-28 18:36:58 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-28 18:36:58 [auto1.de] INFO: Scrape type for HX15626: 2
2026-03-28 18:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with identifier: HX15626
2026-03-28 18:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with scrape type 2
2026-03-28 18:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with scrape type 2
2026-03-28 18:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e53ba7d2-e982-5a07-b326-7a88bf6b09d4, identifier: HX15626
2026-03-28 18:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with identifier: HX15626
2026-03-28 18:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with identifier: HX15626
2026-03-28 18:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e53ba7d2-e982-5a07-b326-7a88bf6b09d4 with identifier: HX15626 to the API
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 315,
 'expiration_date': '2026-03-30T15:24:15Z',
 'fuel_type': 'petrol',
 'id': 'e53ba7d2-e982-5a07-b326-7a88bf6b09d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX15626',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Boxster',
 'odometer': 80132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-04',
 'seller_name': None,
 'title': 'Porsche Boxster S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX15626%27 HTTP/1.1" 200 None
2026-03-28 18:36:59 [auto1.de] INFO: Saving data for HX15626: {'auction_closing_time': 1774884255.0, 'created_time': 1774636311.592716, 'last_price_update_time': 1774723019.246949}
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX15626') HTTP/1.1" 204 0
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG53828%27 HTTP/1.1" 200 None
2026-03-28 18:36:59 [auto1.de] INFO: Scrape type for CG53828: 0
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL20580%27 HTTP/1.1" 200 None
2026-03-28 18:36:59 [auto1.de] INFO: Scrape type for RL20580: 0
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX39550%27 HTTP/1.1" 200 None
2026-03-28 18:36:59 [auto1.de] INFO: Scrape type for AX39550: 0
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK21356%27 HTTP/1.1" 200 None
2026-03-28 18:36:59 [auto1.de] INFO: Scrape type for LK21356: 0
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF33157%27 HTTP/1.1" 200 None
2026-03-28 18:36:59 [auto1.de] INFO: Scrape type for RF33157: 0
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA51695%27 HTTP/1.1" 200 None
2026-03-28 18:36:59 [auto1.de] INFO: Scrape type for MA51695: 0
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT67031%27 HTTP/1.1" 200 None
2026-03-28 18:36:59 [auto1.de] INFO: Scrape type for JT67031: 0
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-28 18:36:59 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-28 18:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:00 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU90427%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Scrape type for FU90427: 0
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL78522%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Scrape type for VL78522: 0
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH91647%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Scrape type for TH91647: 0
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ75768%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Scrape type for LJ75768: 0
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Scrape type for SJ79213: 2
2026-03-28 18:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54776cde-b369-572e-ab46-f5a017a02a66 with identifier: SJ79213
2026-03-28 18:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54776cde-b369-572e-ab46-f5a017a02a66 with scrape type 2
2026-03-28 18:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 54776cde-b369-572e-ab46-f5a017a02a66 with scrape type 2
2026-03-28 18:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54776cde-b369-572e-ab46-f5a017a02a66, identifier: SJ79213
2026-03-28 18:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54776cde-b369-572e-ab46-f5a017a02a66 with identifier: SJ79213
2026-03-28 18:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54776cde-b369-572e-ab46-f5a017a02a66 with identifier: SJ79213
2026-03-28 18:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54776cde-b369-572e-ab46-f5a017a02a66 with identifier: SJ79213 to the API
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:33:18Z',
 'fuel_type': 'petrol',
 'id': '54776cde-b369-572e-ab46-f5a017a02a66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ79213',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 116058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-15',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ79213%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Saving data for SJ79213: {'auction_closing_time': 1774884798.0, 'created_time': 1773401349.434459, 'last_price_update_time': 1774723020.826442}
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ79213') HTTP/1.1" 204 0
2026-03-28 18:37:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH37188%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Scrape type for MH37188: 0
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM12066%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Scrape type for GM12066: 0
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK31638%27 HTTP/1.1" 200 None
2026-03-28 18:37:00 [auto1.de] INFO: Scrape type for DK31638: 0
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-28 18:37:00 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-28 18:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-28 18:37:01 [auto1.de] INFO: Scrape type for PC91683: 2
2026-03-28 18:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with identifier: PC91683
2026-03-28 18:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with scrape type 2
2026-03-28 18:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with scrape type 2
2026-03-28 18:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 754b93c1-df6a-58e8-b540-cbc9b10c69f3, identifier: PC91683
2026-03-28 18:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with identifier: PC91683
2026-03-28 18:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with identifier: PC91683
2026-03-28 18:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 754b93c1-df6a-58e8-b540-cbc9b10c69f3 with identifier: PC91683 to the API
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:32Z',
 'fuel_type': 'diesel',
 'id': '754b93c1-df6a-58e8-b540-cbc9b10c69f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC91683',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 212389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2016}
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC91683%27 HTTP/1.1" 200 None
2026-03-28 18:37:01 [auto1.de] INFO: Saving data for PC91683: {'auction_closing_time': 1774883432.0, 'created_time': 1773426826.734233, 'last_price_update_time': 1774723021.408506}
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC91683') HTTP/1.1" 204 0
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN50102%27 HTTP/1.1" 200 None
2026-03-28 18:37:01 [auto1.de] INFO: Scrape type for GN50102: 0
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG51341%27 HTTP/1.1" 200 None
2026-03-28 18:37:01 [auto1.de] INFO: Scrape type for XG51341: 0
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS00370%27 HTTP/1.1" 200 None
2026-03-28 18:37:01 [auto1.de] INFO: Scrape type for BS00370: 0
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-28 18:37:01 [auto1.de] INFO: Scrape type for HD47083: 2
2026-03-28 18:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c02190-556b-5fea-ab36-2963e29bd29c with identifier: HD47083
2026-03-28 18:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c02190-556b-5fea-ab36-2963e29bd29c with scrape type 2
2026-03-28 18:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94c02190-556b-5fea-ab36-2963e29bd29c with scrape type 2
2026-03-28 18:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94c02190-556b-5fea-ab36-2963e29bd29c, identifier: HD47083
2026-03-28 18:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94c02190-556b-5fea-ab36-2963e29bd29c with identifier: HD47083
2026-03-28 18:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94c02190-556b-5fea-ab36-2963e29bd29c with identifier: HD47083
2026-03-28 18:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94c02190-556b-5fea-ab36-2963e29bd29c with identifier: HD47083 to the API
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:43Z',
 'fuel_type': 'diesel',
 'id': '94c02190-556b-5fea-ab36-2963e29bd29c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD47083',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 163082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI Xcellence',
 'transmission': 'manual',
 'trim': 'Xcellence',
 'year': 2017}
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD47083%27 HTTP/1.1" 200 None
2026-03-28 18:37:01 [auto1.de] INFO: Saving data for HD47083: {'auction_closing_time': 1774883443.0, 'created_time': 1774521432.995276, 'last_price_update_time': 1774723021.888001}
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD47083') HTTP/1.1" 204 0
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-28 18:37:01 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW56933%27 HTTP/1.1" 200 None
2026-03-28 18:37:02 [auto1.de] INFO: Scrape type for XW56933: 0
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT53994%27 HTTP/1.1" 200 None
2026-03-28 18:37:02 [auto1.de] INFO: Scrape type for CT53994: 0
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-28 18:37:02 [auto1.de] INFO: Scrape type for MA63217: 2
2026-03-28 18:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc28b1bd-2cff-5eba-b094-81a3cbee9eed with identifier: MA63217
2026-03-28 18:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc28b1bd-2cff-5eba-b094-81a3cbee9eed with scrape type 2
2026-03-28 18:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc28b1bd-2cff-5eba-b094-81a3cbee9eed with scrape type 2
2026-03-28 18:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc28b1bd-2cff-5eba-b094-81a3cbee9eed, identifier: MA63217
2026-03-28 18:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc28b1bd-2cff-5eba-b094-81a3cbee9eed with identifier: MA63217
2026-03-28 18:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc28b1bd-2cff-5eba-b094-81a3cbee9eed with identifier: MA63217
2026-03-28 18:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc28b1bd-2cff-5eba-b094-81a3cbee9eed with identifier: MA63217 to the API
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:26:56Z',
 'fuel_type': 'petrol',
 'id': 'dc28b1bd-2cff-5eba-b094-81a3cbee9eed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA63217',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 97005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 CrossPolo',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2009}
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA63217%27 HTTP/1.1" 200 None
2026-03-28 18:37:02 [auto1.de] INFO: Saving data for MA63217: {'auction_closing_time': 1774884416.0, 'created_time': 1773945680.124632, 'last_price_update_time': 1774723022.482273}
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA63217') HTTP/1.1" 204 0
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW05271%27 HTTP/1.1" 200 None
2026-03-28 18:37:02 [auto1.de] INFO: Scrape type for LW05271: 0
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-28 18:37:02 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-28 18:37:02 [auto1.de] INFO: Scrape type for DE59201: 2
2026-03-28 18:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ff64b2-63de-597a-9e11-8128352df070 with identifier: DE59201
2026-03-28 18:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ff64b2-63de-597a-9e11-8128352df070 with scrape type 2
2026-03-28 18:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7ff64b2-63de-597a-9e11-8128352df070 with scrape type 2
2026-03-28 18:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7ff64b2-63de-597a-9e11-8128352df070, identifier: DE59201
2026-03-28 18:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7ff64b2-63de-597a-9e11-8128352df070 with identifier: DE59201
2026-03-28 18:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7ff64b2-63de-597a-9e11-8128352df070 with identifier: DE59201
2026-03-28 18:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7ff64b2-63de-597a-9e11-8128352df070 with identifier: DE59201 to the API
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:43:30Z',
 'fuel_type': 'diesel',
 'id': 'c7ff64b2-63de-597a-9e11-8128352df070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE59201',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 173626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.3 JTD Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2011}
2026-03-28 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE59201%27 HTTP/1.1" 200 None
2026-03-28 18:37:03 [auto1.de] INFO: Saving data for DE59201: {'auction_closing_time': 1774885410.0, 'created_time': 1774033877.238789, 'last_price_update_time': 1774723023.047506}
2026-03-28 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE59201') HTTP/1.1" 204 0
2026-03-28 18:37:03 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-28 18:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:03 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:03 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-28 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21062%27 HTTP/1.1" 200 None
2026-03-28 18:37:03 [auto1.de] INFO: Scrape type for RX21062: 0
2026-03-28 18:37:03 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-28 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-28 18:37:03 [auto1.de] INFO: Scrape type for XK18770: 2
2026-03-28 18:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d30f394-1371-5fc2-941d-d139fce0970c with identifier: XK18770
2026-03-28 18:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d30f394-1371-5fc2-941d-d139fce0970c with scrape type 2
2026-03-28 18:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d30f394-1371-5fc2-941d-d139fce0970c with scrape type 2
2026-03-28 18:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d30f394-1371-5fc2-941d-d139fce0970c, identifier: XK18770
2026-03-28 18:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d30f394-1371-5fc2-941d-d139fce0970c with identifier: XK18770
2026-03-28 18:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d30f394-1371-5fc2-941d-d139fce0970c with identifier: XK18770
2026-03-28 18:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d30f394-1371-5fc2-941d-d139fce0970c with identifier: XK18770 to the API
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:43:18Z',
 'fuel_type': 'diesel',
 'id': '3d30f394-1371-5fc2-941d-d139fce0970c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK18770',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 122046,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-31',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBlue TDCi Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2020}
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK18770%27 HTTP/1.1" 200 None
2026-03-28 18:37:04 [auto1.de] INFO: Saving data for XK18770: {'auction_closing_time': 1774885398.0, 'created_time': 1773985178.460841, 'last_price_update_time': 1774723024.395236}
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK18770') HTTP/1.1" 204 0
2026-03-28 18:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD63369%27 HTTP/1.1" 200 None
2026-03-28 18:37:04 [auto1.de] INFO: Scrape type for UD63369: 0
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP95900%27 HTTP/1.1" 200 None
2026-03-28 18:37:04 [auto1.de] INFO: Scrape type for XP95900: 0
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-28 18:37:04 [auto1.de] INFO: Scrape type for ND25281: 2
2026-03-28 18:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with identifier: ND25281
2026-03-28 18:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with scrape type 2
2026-03-28 18:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with scrape type 2
2026-03-28 18:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b801ca3-962c-5835-8738-55ba3ee7a4f6, identifier: ND25281
2026-03-28 18:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with identifier: ND25281
2026-03-28 18:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with identifier: ND25281
2026-03-28 18:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b801ca3-962c-5835-8738-55ba3ee7a4f6 with identifier: ND25281 to the API
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:48:52Z',
 'fuel_type': 'petrol',
 'id': '0b801ca3-962c-5835-8738-55ba3ee7a4f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND25281',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 99677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2014}
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND25281%27 HTTP/1.1" 200 None
2026-03-28 18:37:04 [auto1.de] INFO: Saving data for ND25281: {'auction_closing_time': 1774885732.0, 'created_time': 1774636268.910582, 'last_price_update_time': 1774723024.865894}
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND25281') HTTP/1.1" 204 0
2026-03-28 18:37:04 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ16106%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for HZ16106: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD67792%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for SD67792: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE21956%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for LE21956: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC73852%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for SC73852: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU06987%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for AU06987: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL60481%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for SL60481: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX98211%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for SX98211: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU55800%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for YU55800: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41795%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for VE41795: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY43681%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for YY43681: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB97430%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for PB97430: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV56207%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for PV56207: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH92244%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for NH92244: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW00961%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for DW00961: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB62347%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for YB62347: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for AW92068: 2
2026-03-28 18:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8db83e5-266d-5101-9391-5958f831b209 with identifier: AW92068
2026-03-28 18:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8db83e5-266d-5101-9391-5958f831b209 with scrape type 2
2026-03-28 18:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8db83e5-266d-5101-9391-5958f831b209 with scrape type 2
2026-03-28 18:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8db83e5-266d-5101-9391-5958f831b209, identifier: AW92068
2026-03-28 18:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8db83e5-266d-5101-9391-5958f831b209 with identifier: AW92068
2026-03-28 18:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8db83e5-266d-5101-9391-5958f831b209 with identifier: AW92068
2026-03-28 18:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8db83e5-266d-5101-9391-5958f831b209 with identifier: AW92068 to the API
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:11:38Z',
 'fuel_type': 'petrol',
 'id': 'e8db83e5-266d-5101-9391-5958f831b209',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW92068',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'CTS',
 'odometer': 25323,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-28',
 'seller_name': None,
 'title': 'Cadillac CTS 2.0 Performance AWD',
 'transmission': 'automatic',
 'trim': 'Performance AWD',
 'year': 2016}
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW92068%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Saving data for AW92068: {'auction_closing_time': 1774883498.0, 'created_time': 1773399740.768632, 'last_price_update_time': 1774723025.652114}
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW92068') HTTP/1.1" 204 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ13308%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for MJ13308: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD43064%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for BD43064: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS70073%27 HTTP/1.1" 200 None
2026-03-28 18:37:05 [auto1.de] INFO: Scrape type for VS70073: 0
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-28 18:37:05 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-28 18:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:06 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP04220%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for WP04220: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02715%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for FZ02715: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX30716%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for UX30716: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20078%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for ZJ20078: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY02769%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for KY02769: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB37074%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for WB37074: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF95451%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for JF95451: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB26331%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for DB26331: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS04919%27 HTTP/1.1" 200 None
2026-03-28 18:37:06 [auto1.de] INFO: Scrape type for ZS04919: 0
2026-03-28 18:37:06 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for TK27520: 2
2026-03-28 18:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with identifier: TK27520
2026-03-28 18:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with scrape type 2
2026-03-28 18:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with scrape type 2
2026-03-28 18:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc, identifier: TK27520
2026-03-28 18:37:07 [scrapy.extensions.logstats] INFO: Crawled 155 pages (at 11 pages/min), scraped 385 items (at 36 items/min)
2026-03-28 18:37:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 158MiB
2026-03-28 18:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with identifier: TK27520
2026-03-28 18:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with identifier: TK27520
2026-03-28 18:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d22d232-cd4e-5e2c-9fe5-6eab564230bc with identifier: TK27520 to the API
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:45:21Z',
 'fuel_type': 'diesel',
 'id': '8d22d232-cd4e-5e2c-9fe5-6eab564230bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK27520',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 256458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-12',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI 120 Jahre Start/Stop',
 'transmission': 'automatic',
 'trim': '120 Jahre Start/Stop',
 'year': 2018}
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK27520%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Saving data for TK27520: {'auction_closing_time': 1774885521.0, 'created_time': 1774521253.046305, 'last_price_update_time': 1774723027.4301}
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK27520') HTTP/1.1" 204 0
2026-03-28 18:37:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW20064%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for VW20064: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK66468%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for LK66468: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW95662%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for PW95662: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR60766%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for JR60766: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV09971%27 HTTP/1.1" 200 None
2026-03-28 18:37:07 [auto1.de] INFO: Scrape type for YV09971: 0
2026-03-28 18:37:07 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-28 18:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:08 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:08 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-28 18:37:08 [auto1.de] INFO: Scrape type for KF40481: 2
2026-03-28 18:37:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dd620a7-335f-5177-8603-ca8588b393b6 with identifier: KF40481
2026-03-28 18:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dd620a7-335f-5177-8603-ca8588b393b6 with scrape type 2
2026-03-28 18:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dd620a7-335f-5177-8603-ca8588b393b6 with scrape type 2
2026-03-28 18:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dd620a7-335f-5177-8603-ca8588b393b6, identifier: KF40481
2026-03-28 18:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dd620a7-335f-5177-8603-ca8588b393b6 with identifier: KF40481
2026-03-28 18:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dd620a7-335f-5177-8603-ca8588b393b6 with identifier: KF40481
2026-03-28 18:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dd620a7-335f-5177-8603-ca8588b393b6 with identifier: KF40481 to the API
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:10:53Z',
 'fuel_type': 'diesel',
 'id': '4dd620a7-335f-5177-8603-ca8588b393b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF40481',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 245958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC Exclusive',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Exclusive',
 'year': 2015}
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF40481%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Saving data for KF40481: {'auction_closing_time': 1774883453.0, 'created_time': 1773467738.69708, 'last_price_update_time': 1774723029.042155}
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF40481') HTTP/1.1" 204 0
2026-03-28 18:37:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH53408%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for GH53408: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for EG14085: 2
2026-03-28 18:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with identifier: EG14085
2026-03-28 18:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with scrape type 2
2026-03-28 18:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with scrape type 2
2026-03-28 18:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae, identifier: EG14085
2026-03-28 18:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with identifier: EG14085
2026-03-28 18:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with identifier: EG14085
2026-03-28 18:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a78b96b-cc9a-54ce-8a88-7191c542d9ae with identifier: EG14085 to the API
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:45:30Z',
 'fuel_type': 'petrol',
 'id': '3a78b96b-cc9a-54ce-8a88-7191c542d9ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG14085',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 294416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-04',
 'seller_name': None,
 'title': 'BMW X1 xDrive 28i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG14085%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Saving data for EG14085: {'auction_closing_time': 1774885530.0, 'created_time': 1774636312.404874, 'last_price_update_time': 1774723029.601127}
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG14085') HTTP/1.1" 204 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ08644%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for NJ08644: 0
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-28 18:37:09 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-28 18:37:09 [auto1.de] INFO: Scrape type for XP52765: 2
2026-03-28 18:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 267c74ff-4f29-5431-bd4f-66ab368066b2 with identifier: XP52765
2026-03-28 18:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 267c74ff-4f29-5431-bd4f-66ab368066b2 with scrape type 2
2026-03-28 18:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 267c74ff-4f29-5431-bd4f-66ab368066b2 with scrape type 2
2026-03-28 18:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 267c74ff-4f29-5431-bd4f-66ab368066b2, identifier: XP52765
2026-03-28 18:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 267c74ff-4f29-5431-bd4f-66ab368066b2 with identifier: XP52765
2026-03-28 18:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 267c74ff-4f29-5431-bd4f-66ab368066b2 with identifier: XP52765
2026-03-28 18:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 267c74ff-4f29-5431-bd4f-66ab368066b2 with identifier: XP52765 to the API
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:49:19Z',
 'fuel_type': 'petrol',
 'id': '267c74ff-4f29-5431-bd4f-66ab368066b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP52765',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 103385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-15',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2009}
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP52765%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Saving data for XP52765: {'auction_closing_time': 1774885759.0, 'created_time': 1773427523.810322, 'last_price_update_time': 1774723030.072207}
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP52765') HTTP/1.1" 204 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM78498%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for UM78498: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for WM97258: 2
2026-03-28 18:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with identifier: WM97258
2026-03-28 18:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with scrape type 2
2026-03-28 18:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with scrape type 2
2026-03-28 18:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63904e79-c2a1-5dc7-b6fa-b4f71509d070, identifier: WM97258
2026-03-28 18:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with identifier: WM97258
2026-03-28 18:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with identifier: WM97258
2026-03-28 18:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63904e79-c2a1-5dc7-b6fa-b4f71509d070 with identifier: WM97258 to the API
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:26:41Z',
 'fuel_type': 'petrol',
 'id': '63904e79-c2a1-5dc7-b6fa-b4f71509d070',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM97258',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 125283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-23',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM97258%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Saving data for WM97258: {'auction_closing_time': 1774884401.0, 'created_time': 1773428367.319937, 'last_price_update_time': 1774723030.563473}
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM97258') HTTP/1.1" 204 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM40362%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for CM40362: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM34350%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for NM34350: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR95104%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for RR95104: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ52783%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for CJ52783: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG36075%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for XG36075: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT60499%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for YT60499: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU85888%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for ZU85888: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK81412%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for DK81412: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT57416%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for GT57416: 0
2026-03-28 18:37:10 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-28 18:37:10 [auto1.de] INFO: Scrape type for SK08799: 2
2026-03-28 18:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28aa186b-4279-5dd4-9837-779fbae1060d with identifier: SK08799
2026-03-28 18:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28aa186b-4279-5dd4-9837-779fbae1060d with scrape type 2
2026-03-28 18:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28aa186b-4279-5dd4-9837-779fbae1060d with scrape type 2
2026-03-28 18:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28aa186b-4279-5dd4-9837-779fbae1060d, identifier: SK08799
2026-03-28 18:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28aa186b-4279-5dd4-9837-779fbae1060d with identifier: SK08799
2026-03-28 18:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28aa186b-4279-5dd4-9837-779fbae1060d with identifier: SK08799
2026-03-28 18:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28aa186b-4279-5dd4-9837-779fbae1060d with identifier: SK08799 to the API
2026-03-28 18:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:10Z',
 'fuel_type': 'petrol',
 'id': '28aa186b-4279-5dd4-9837-779fbae1060d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK08799',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 82435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK08799%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Saving data for SK08799: {'auction_closing_time': 1774883830.0, 'created_time': 1774521726.715897, 'last_price_update_time': 1774723031.231122}
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK08799') HTTP/1.1" 204 0
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK32752%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Scrape type for MK32752: 0
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS74184%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Scrape type for YS74184: 0
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA97502%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Scrape type for PA97502: 0
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Scrape type for VS20151: 2
2026-03-28 18:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ac86c52-4369-5daf-b646-00187e7a692b with identifier: VS20151
2026-03-28 18:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ac86c52-4369-5daf-b646-00187e7a692b with scrape type 2
2026-03-28 18:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ac86c52-4369-5daf-b646-00187e7a692b with scrape type 2
2026-03-28 18:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ac86c52-4369-5daf-b646-00187e7a692b, identifier: VS20151
2026-03-28 18:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ac86c52-4369-5daf-b646-00187e7a692b with identifier: VS20151
2026-03-28 18:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ac86c52-4369-5daf-b646-00187e7a692b with identifier: VS20151
2026-03-28 18:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ac86c52-4369-5daf-b646-00187e7a692b with identifier: VS20151 to the API
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:28Z',
 'fuel_type': 'diesel',
 'id': '1ac86c52-4369-5daf-b646-00187e7a692b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS20151',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 155928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2019}
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS20151%27 HTTP/1.1" 200 None
2026-03-28 18:37:11 [auto1.de] INFO: Saving data for VS20151: {'auction_closing_time': 1774885528.0, 'created_time': 1773400082.501929, 'last_price_update_time': 1774723031.817145}
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS20151') HTTP/1.1" 204 0
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-28 18:37:11 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-28 18:37:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:12 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST89847%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for ST89847: 0
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for JR87294: 2
2026-03-28 18:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with identifier: JR87294
2026-03-28 18:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with scrape type 2
2026-03-28 18:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with scrape type 2
2026-03-28 18:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4, identifier: JR87294
2026-03-28 18:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with identifier: JR87294
2026-03-28 18:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with identifier: JR87294
2026-03-28 18:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4 with identifier: JR87294 to the API
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:30:15Z',
 'fuel_type': 'petrol',
 'id': 'cd0d47d2-80a3-5261-8e76-b8e8c4f02fd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR87294',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 47682,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-05',
 'seller_name': None,
 'title': 'Smart forfour 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR87294%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Saving data for JR87294: {'auction_closing_time': 1774884615.0, 'created_time': 1774521133.030765, 'last_price_update_time': 1774723032.642703}
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR87294') HTTP/1.1" 204 0
2026-03-28 18:37:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV46397%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for FV46397: 0
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL60682%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for LL60682: 0
2026-03-28 18:37:12 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-28 18:37:12 [auto1.de] INFO: Scrape type for XV15906: 2
2026-03-28 18:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with identifier: XV15906
2026-03-28 18:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with scrape type 2
2026-03-28 18:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with scrape type 2
2026-03-28 18:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4, identifier: XV15906
2026-03-28 18:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with identifier: XV15906
2026-03-28 18:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with identifier: XV15906
2026-03-28 18:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 666faad5-4cf8-56c3-b8b5-ffec1c29c1a4 with identifier: XV15906 to the API
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:55:16Z',
 'fuel_type': 'petrol',
 'id': '666faad5-4cf8-56c3-b8b5-ffec1c29c1a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV15906',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 239299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV15906%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Saving data for XV15906: {'auction_closing_time': 1774886116.0, 'created_time': 1774522010.27279, 'last_price_update_time': 1774723033.227131}
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV15906') HTTP/1.1" 204 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB77182%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for RB77182: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for HA44433: 2
2026-03-28 18:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7c970f9-065a-51fb-aa8f-aae41c1e8396 with identifier: HA44433
2026-03-28 18:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7c970f9-065a-51fb-aa8f-aae41c1e8396 with scrape type 2
2026-03-28 18:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7c970f9-065a-51fb-aa8f-aae41c1e8396 with scrape type 2
2026-03-28 18:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7c970f9-065a-51fb-aa8f-aae41c1e8396, identifier: HA44433
2026-03-28 18:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7c970f9-065a-51fb-aa8f-aae41c1e8396 with identifier: HA44433
2026-03-28 18:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7c970f9-065a-51fb-aa8f-aae41c1e8396 with identifier: HA44433
2026-03-28 18:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7c970f9-065a-51fb-aa8f-aae41c1e8396 with identifier: HA44433 to the API
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:37:57Z',
 'fuel_type': 'petrol',
 'id': 'a7c970f9-065a-51fb-aa8f-aae41c1e8396',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA44433',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 212675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-31',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA44433%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Saving data for HA44433: {'auction_closing_time': 1774885077.0, 'created_time': 1774636551.55244, 'last_price_update_time': 1774723033.695397}
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA44433') HTTP/1.1" 204 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC89371%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for CC89371: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX01003%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for BX01003: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB00515%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for PB00515: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK17231%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for LK17231: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL09257%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for LL09257: 0
2026-03-28 18:37:13 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-28 18:37:13 [auto1.de] INFO: Scrape type for EX67189: 2
2026-03-28 18:37:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9520c1f3-c685-53e4-87dd-0450025efb61 with identifier: EX67189
2026-03-28 18:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9520c1f3-c685-53e4-87dd-0450025efb61 with scrape type 2
2026-03-28 18:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9520c1f3-c685-53e4-87dd-0450025efb61 with scrape type 2
2026-03-28 18:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9520c1f3-c685-53e4-87dd-0450025efb61, identifier: EX67189
2026-03-28 18:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9520c1f3-c685-53e4-87dd-0450025efb61 with identifier: EX67189
2026-03-28 18:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9520c1f3-c685-53e4-87dd-0450025efb61 with identifier: EX67189
2026-03-28 18:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9520c1f3-c685-53e4-87dd-0450025efb61 with identifier: EX67189 to the API
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:39Z',
 'fuel_type': 'petrol',
 'id': '9520c1f3-c685-53e4-87dd-0450025efb61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX67189',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 65196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-06',
 'seller_name': None,
 'title': 'Renault Kadjar 1.3 TCe Zen',
 'transmission': 'automatic',
 'trim': 'Zen',
 'year': 2022}
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX67189%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Saving data for EX67189: {'auction_closing_time': 1774883919.0, 'created_time': 1774118453.993817, 'last_price_update_time': 1774723034.270367}
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX67189') HTTP/1.1" 204 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS94316%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for KS94316: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC92751%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for SC92751: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML83071%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for ML83071: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL63918%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for YL63918: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP96640%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for TP96640: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG07330%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for CG07330: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX44757%27 HTTP/1.1" 200 None
2026-03-28 18:37:14 [auto1.de] INFO: Scrape type for EX44757: 0
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-28 18:37:14 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-28 18:37:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:15 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: US86443
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US86443%27 HTTP/1.1" 200 None
2026-03-28 18:37:15 [auto1.de] INFO: Scrape type for US86443: 0
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR15758%27 HTTP/1.1" 200 None
2026-03-28 18:37:15 [auto1.de] INFO: Scrape type for XR15758: 0
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV40211%27 HTTP/1.1" 200 None
2026-03-28 18:37:15 [auto1.de] INFO: Scrape type for HV40211: 0
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG52180%27 HTTP/1.1" 200 None
2026-03-28 18:37:15 [auto1.de] INFO: Scrape type for ZG52180: 0
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-28 18:37:15 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-28 18:37:15 [auto1.de] INFO: Scrape type for JY24308: 2
2026-03-28 18:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23207390-4db0-57f8-8667-f0ad96e45247 with identifier: JY24308
2026-03-28 18:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23207390-4db0-57f8-8667-f0ad96e45247 with scrape type 2
2026-03-28 18:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23207390-4db0-57f8-8667-f0ad96e45247 with scrape type 2
2026-03-28 18:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23207390-4db0-57f8-8667-f0ad96e45247, identifier: JY24308
2026-03-28 18:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23207390-4db0-57f8-8667-f0ad96e45247 with identifier: JY24308
2026-03-28 18:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23207390-4db0-57f8-8667-f0ad96e45247 with identifier: JY24308
2026-03-28 18:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23207390-4db0-57f8-8667-f0ad96e45247 with identifier: JY24308 to the API
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:30:45Z',
 'fuel_type': 'petrol',
 'id': '23207390-4db0-57f8-8667-f0ad96e45247',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY24308',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 76181,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY24308%27 HTTP/1.1" 200 None
2026-03-28 18:37:15 [auto1.de] INFO: Saving data for JY24308: {'auction_closing_time': 1774884645.0, 'created_time': 1773945641.40919, 'last_price_update_time': 1774723035.891791}
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY24308') HTTP/1.1" 204 0
2026-03-28 18:37:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ15430%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for RJ15430: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV65946%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for DV65946: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ26450%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for VJ26450: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD91634%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for UD91634: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN11419%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for DN11419: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for UL11229: 2
2026-03-28 18:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72e48121-a728-5107-a088-97b380c6d5c1 with identifier: UL11229
2026-03-28 18:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72e48121-a728-5107-a088-97b380c6d5c1 with scrape type 2
2026-03-28 18:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72e48121-a728-5107-a088-97b380c6d5c1 with scrape type 2
2026-03-28 18:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72e48121-a728-5107-a088-97b380c6d5c1, identifier: UL11229
2026-03-28 18:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72e48121-a728-5107-a088-97b380c6d5c1 with identifier: UL11229
2026-03-28 18:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72e48121-a728-5107-a088-97b380c6d5c1 with identifier: UL11229
2026-03-28 18:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72e48121-a728-5107-a088-97b380c6d5c1 with identifier: UL11229 to the API
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:38:59Z',
 'fuel_type': 'hybrid',
 'id': '72e48121-a728-5107-a088-97b380c6d5c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL11229',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 75637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL11229%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Saving data for UL11229: {'auction_closing_time': 1774885139.0, 'created_time': 1774118443.35216, 'last_price_update_time': 1774723036.543983}
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL11229') HTTP/1.1" 204 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC38783%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for WC38783: 0
2026-03-28 18:37:16 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-28 18:37:16 [auto1.de] INFO: Scrape type for NA89904: 2
2026-03-28 18:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with identifier: NA89904
2026-03-28 18:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with scrape type 2
2026-03-28 18:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with scrape type 2
2026-03-28 18:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f, identifier: NA89904
2026-03-28 18:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with identifier: NA89904
2026-03-28 18:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with identifier: NA89904
2026-03-28 18:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f with identifier: NA89904 to the API
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:16:46Z',
 'fuel_type': 'petrol',
 'id': '0d77d2bc-4d6d-5d34-9b2f-d17268fe3a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA89904',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS3',
 'odometer': 145208,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-10',
 'seller_name': None,
 'title': 'Citroen DS3 1.6 THP SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2013}
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA89904%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Saving data for NA89904: {'auction_closing_time': 1774883806.0, 'created_time': 1774636340.838668, 'last_price_update_time': 1774723037.01171}
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA89904') HTTP/1.1" 204 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62018%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for KB62018: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF93741%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for HF93741: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN00313%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for VN00313: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC48235%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for UC48235: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG68555%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for AG68555: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for GV24790: 2
2026-03-28 18:37:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-03-28 18:37:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e646652c-9b01-55dd-b97c-99c0ed9f989f with scrape type 2
2026-03-28 18:37:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e646652c-9b01-55dd-b97c-99c0ed9f989f with scrape type 2
2026-03-28 18:37:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e646652c-9b01-55dd-b97c-99c0ed9f989f, identifier: GV24790
2026-03-28 18:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-03-28 18:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790
2026-03-28 18:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e646652c-9b01-55dd-b97c-99c0ed9f989f with identifier: GV24790 to the API
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:48:37Z',
 'fuel_type': 'petrol',
 'id': 'e646652c-9b01-55dd-b97c-99c0ed9f989f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV24790',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 80845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-01',
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Coupe',
 'transmission': 'automatic',
 'trim': 'Coupe',
 'year': 2010}
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV24790%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Saving data for GV24790: {'auction_closing_time': 1774885717.0, 'created_time': 1773224202.294027, 'last_price_update_time': 1774723037.597628}
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV24790') HTTP/1.1" 204 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN13946%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for JN13946: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE28952%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for UE28952: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE12757%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for AE12757: 0
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-28 18:37:17 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA58010%27 HTTP/1.1" 200 None
2026-03-28 18:37:17 [auto1.de] INFO: Scrape type for GA58010: 0
2026-03-28 18:37:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:18 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ97721%27 HTTP/1.1" 200 None
2026-03-28 18:37:18 [auto1.de] INFO: Scrape type for DJ97721: 0
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ27483%27 HTTP/1.1" 200 None
2026-03-28 18:37:18 [auto1.de] INFO: Scrape type for PZ27483: 0
2026-03-28 18:37:18 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-28 18:37:18 [auto1.de] INFO: Scrape type for XD68871: 2
2026-03-28 18:37:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with identifier: XD68871
2026-03-28 18:37:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with scrape type 2
2026-03-28 18:37:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with scrape type 2
2026-03-28 18:37:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719, identifier: XD68871
2026-03-28 18:37:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with identifier: XD68871
2026-03-28 18:37:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with identifier: XD68871
2026-03-28 18:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ebbb1595-01f9-52a3-9a30-cfe2c9dc3719 with identifier: XD68871 to the API
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:55:05Z',
 'fuel_type': 'diesel',
 'id': 'ebbb1595-01f9-52a3-9a30-cfe2c9dc3719',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD68871',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 106694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-04',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Portfolio AWD',
 'transmission': 'automatic',
 'trim': 'Portfolio AWD',
 'year': 2018}
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD68871%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Saving data for XD68871: {'auction_closing_time': 1774886105.0, 'created_time': 1774349697.403532, 'last_price_update_time': 1774723039.245738}
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD68871') HTTP/1.1" 204 0
2026-03-28 18:37:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE72511%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for ZE72511: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE41412%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for VE41412: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH31570%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for FH31570: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP71410%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for MP71410: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV69616%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for SV69616: 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Scrape type for VB56822: 2
2026-03-28 18:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99e83a1c-ba38-5055-8174-76c1d9e249b7 with identifier: VB56822
2026-03-28 18:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99e83a1c-ba38-5055-8174-76c1d9e249b7 with scrape type 2
2026-03-28 18:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99e83a1c-ba38-5055-8174-76c1d9e249b7 with scrape type 2
2026-03-28 18:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99e83a1c-ba38-5055-8174-76c1d9e249b7, identifier: VB56822
2026-03-28 18:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99e83a1c-ba38-5055-8174-76c1d9e249b7 with identifier: VB56822
2026-03-28 18:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99e83a1c-ba38-5055-8174-76c1d9e249b7 with identifier: VB56822
2026-03-28 18:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99e83a1c-ba38-5055-8174-76c1d9e249b7 with identifier: VB56822 to the API
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:56:27Z',
 'fuel_type': 'petrol',
 'id': '99e83a1c-ba38-5055-8174-76c1d9e249b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB56822',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 79851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB56822%27 HTTP/1.1" 200 None
2026-03-28 18:37:19 [auto1.de] INFO: Saving data for VB56822: {'auction_closing_time': 1774886187.0, 'created_time': 1774636320.238812, 'last_price_update_time': 1774723039.880589}
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB56822') HTTP/1.1" 204 0
2026-03-28 18:37:19 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-28 18:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM11779%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for HM11779: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU93791%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for CU93791: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB81332%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for EB81332: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD20559%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for DD20559: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG31546%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for SG31546: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ68458%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for NZ68458: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for CU11315: 2
2026-03-28 18:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408cb80f-33cb-59ab-a1bf-8adcec779395 with identifier: CU11315
2026-03-28 18:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408cb80f-33cb-59ab-a1bf-8adcec779395 with scrape type 2
2026-03-28 18:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 408cb80f-33cb-59ab-a1bf-8adcec779395 with scrape type 2
2026-03-28 18:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 408cb80f-33cb-59ab-a1bf-8adcec779395, identifier: CU11315
2026-03-28 18:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 408cb80f-33cb-59ab-a1bf-8adcec779395 with identifier: CU11315
2026-03-28 18:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 408cb80f-33cb-59ab-a1bf-8adcec779395 with identifier: CU11315
2026-03-28 18:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 408cb80f-33cb-59ab-a1bf-8adcec779395 with identifier: CU11315 to the API
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:23:37Z',
 'fuel_type': 'diesel',
 'id': '408cb80f-33cb-59ab-a1bf-8adcec779395',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU11315',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 308833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU11315%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Saving data for CU11315: {'auction_closing_time': 1774884217.0, 'created_time': 1774636286.576798, 'last_price_update_time': 1774723040.527559}
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU11315') HTTP/1.1" 204 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13649%27 HTTP/1.1" 200 None
2026-03-28 18:37:20 [auto1.de] INFO: Scrape type for CD13649: 0
2026-03-28 18:37:20 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-28 18:37:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:21 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68536%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for KW68536: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP82527%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for BP82527: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32627%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for FX32627: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER89217%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for ER89217: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM89515%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for XM89515: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX10295%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for BX10295: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56224%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for KV56224: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM11561%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for YM11561: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR41525%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for RR41525: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63753%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for XB63753: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY78817%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for VY78817: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS86907%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for GS86907: 0
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-28 18:37:21 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-28 18:37:21 [auto1.de] INFO: Scrape type for YS84502: 2
2026-03-28 18:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-03-28 18:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb997bed-8db8-585d-9ca4-2febcee1f0b0 with scrape type 2
2026-03-28 18:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb997bed-8db8-585d-9ca4-2febcee1f0b0 with scrape type 2
2026-03-28 18:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb997bed-8db8-585d-9ca4-2febcee1f0b0, identifier: YS84502
2026-03-28 18:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-03-28 18:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502
2026-03-28 18:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb997bed-8db8-585d-9ca4-2febcee1f0b0 with identifier: YS84502 to the API
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:28:57Z',
 'fuel_type': 'diesel',
 'id': 'cb997bed-8db8-585d-9ca4-2febcee1f0b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS84502',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 369064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2007}
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS84502%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Saving data for YS84502: {'auction_closing_time': 1774884537.0, 'created_time': 1774034348.056446, 'last_price_update_time': 1774723042.23189}
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS84502') HTTP/1.1" 204 0
2026-03-28 18:37:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-28 18:37:22 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK83365%27 HTTP/1.1" 200 None
2026-03-28 18:37:22 [auto1.de] INFO: Scrape type for LK83365: 0
2026-03-28 18:37:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:23 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 6002 | hits on page: 40
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM33145%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for CM33145: 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB90216%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for XB90216: 0
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-28 18:37:23 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-28 18:37:23 [auto1.de] INFO: Scrape type for CZ44674: 2
2026-03-28 18:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d596886-b685-5b08-b93a-a0a5853436a6 with identifier: CZ44674
2026-03-28 18:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d596886-b685-5b08-b93a-a0a5853436a6 with scrape type 2
2026-03-28 18:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d596886-b685-5b08-b93a-a0a5853436a6 with scrape type 2
2026-03-28 18:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d596886-b685-5b08-b93a-a0a5853436a6, identifier: CZ44674
2026-03-28 18:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d596886-b685-5b08-b93a-a0a5853436a6 with identifier: CZ44674
2026-03-28 18:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d596886-b685-5b08-b93a-a0a5853436a6 with identifier: CZ44674
2026-03-28 18:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d596886-b685-5b08-b93a-a0a5853436a6 with identifier: CZ44674 to the API
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:55:29Z',
 'fuel_type': 'diesel',
 'id': '4d596886-b685-5b08-b93a-a0a5853436a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ44674',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 206292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-05',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Design',
 'transmission': 'automatic',
 'trim': 'quattro Design',
 'year': 2015}
2026-03-28 18:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ44674%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Saving data for CZ44674: {'auction_closing_time': 1774886129.0, 'created_time': 1774636497.953446, 'last_price_update_time': 1774723044.001796}
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ44674') HTTP/1.1" 204 0
2026-03-28 18:37:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP53076%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Scrape type for HP53076: 0
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV99123%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Scrape type for HV99123: 0
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV40301%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Scrape type for NV40301: 0
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Scrape type for TN09859: 2
2026-03-28 18:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with identifier: TN09859
2026-03-28 18:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with scrape type 2
2026-03-28 18:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with scrape type 2
2026-03-28 18:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f, identifier: TN09859
2026-03-28 18:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with identifier: TN09859
2026-03-28 18:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with identifier: TN09859
2026-03-28 18:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f with identifier: TN09859 to the API
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:17:53Z',
 'fuel_type': 'petrol',
 'id': 'c96977e0-5230-5c0a-9c7d-c1cef5d8ae2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN09859',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 117424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-16',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2014}
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN09859%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Saving data for TN09859: {'auction_closing_time': 1774883873.0, 'created_time': 1774522061.308603, 'last_price_update_time': 1774723044.619731}
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN09859') HTTP/1.1" 204 0
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE10872%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Scrape type for ZE10872: 0
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY38359%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Scrape type for AY38359: 0
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-28 18:37:24 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-28 18:37:24 [auto1.de] INFO: Scrape type for ZF02079: 2
2026-03-28 18:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac5beb0d-723e-59ce-aa7a-6623ac059b46 with identifier: ZF02079
2026-03-28 18:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac5beb0d-723e-59ce-aa7a-6623ac059b46 with scrape type 2
2026-03-28 18:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac5beb0d-723e-59ce-aa7a-6623ac059b46 with scrape type 2
2026-03-28 18:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac5beb0d-723e-59ce-aa7a-6623ac059b46, identifier: ZF02079
2026-03-28 18:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac5beb0d-723e-59ce-aa7a-6623ac059b46 with identifier: ZF02079
2026-03-28 18:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac5beb0d-723e-59ce-aa7a-6623ac059b46 with identifier: ZF02079
2026-03-28 18:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac5beb0d-723e-59ce-aa7a-6623ac059b46 with identifier: ZF02079 to the API
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:55Z',
 'fuel_type': 'diesel',
 'id': 'ac5beb0d-723e-59ce-aa7a-6623ac059b46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF02079',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 166733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-03',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF02079%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Saving data for ZF02079: {'auction_closing_time': 1774883875.0, 'created_time': 1773402027.432263, 'last_price_update_time': 1774723045.099248}
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF02079') HTTP/1.1" 204 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ40219%27 HTTP/1.1" 200 None
2026-03-28 18:37:25 [auto1.de] INFO: Scrape type for FZ40219: 0
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-28 18:37:25 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-28 18:37:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:26 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS15071%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for JS15071: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY73359%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for AY73359: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ58938%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for CZ58938: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW41048%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for FW41048: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN98432%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for SN98432: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT08525%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for XT08525: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL14438%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for FL14438: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL59385%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for GL59385: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA47632%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for MA47632: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP13896%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for AP13896: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05570%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for AB05570: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP92874%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for AP92874: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX75388%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for HX75388: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU16486%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for LU16486: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV60687%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for TV60687: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ75418%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for KJ75418: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23658%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for PR23658: 0
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-28 18:37:26 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA50565%27 HTTP/1.1" 200 None
2026-03-28 18:37:26 [auto1.de] INFO: Scrape type for CA50565: 0
2026-03-28 18:37:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:27 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX68947%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for LX68947: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE73392%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for GE73392: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF90530%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for PF90530: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN42361%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for XN42361: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW26780%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for ZW26780: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06464%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for VX06464: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA93486%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for JA93486: 0
2026-03-28 18:37:27 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-28 18:37:27 [auto1.de] INFO: Scrape type for UC09176: 2
2026-03-28 18:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1037979a-f613-5923-bc9a-9d1497ed05ef with identifier: UC09176
2026-03-28 18:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1037979a-f613-5923-bc9a-9d1497ed05ef with scrape type 2
2026-03-28 18:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1037979a-f613-5923-bc9a-9d1497ed05ef with scrape type 2
2026-03-28 18:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1037979a-f613-5923-bc9a-9d1497ed05ef, identifier: UC09176
2026-03-28 18:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1037979a-f613-5923-bc9a-9d1497ed05ef with identifier: UC09176
2026-03-28 18:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1037979a-f613-5923-bc9a-9d1497ed05ef with identifier: UC09176
2026-03-28 18:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1037979a-f613-5923-bc9a-9d1497ed05ef with identifier: UC09176 to the API
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:31:25Z',
 'fuel_type': 'petrol',
 'id': '1037979a-f613-5923-bc9a-9d1497ed05ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC09176',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 202452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-12-16',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 320 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 1998}
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC09176%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Saving data for UC09176: {'auction_closing_time': 1774884685.0, 'created_time': 1774522624.584151, 'last_price_update_time': 1774723048.094769}
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC09176') HTTP/1.1" 204 0
2026-03-28 18:37:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY02082%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for VY02082: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE09566%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for DE09566: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD78649%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for HD78649: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG82717%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for UG82717: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69017%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for KA69017: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for JH22526: 2
2026-03-28 18:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d38e7110-80dd-53d8-99f6-4f6a798559b0 with identifier: JH22526
2026-03-28 18:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d38e7110-80dd-53d8-99f6-4f6a798559b0 with scrape type 2
2026-03-28 18:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d38e7110-80dd-53d8-99f6-4f6a798559b0 with scrape type 2
2026-03-28 18:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d38e7110-80dd-53d8-99f6-4f6a798559b0, identifier: JH22526
2026-03-28 18:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d38e7110-80dd-53d8-99f6-4f6a798559b0 with identifier: JH22526
2026-03-28 18:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d38e7110-80dd-53d8-99f6-4f6a798559b0 with identifier: JH22526
2026-03-28 18:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d38e7110-80dd-53d8-99f6-4f6a798559b0 with identifier: JH22526 to the API
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:30:14Z',
 'fuel_type': 'petrol',
 'id': 'd38e7110-80dd-53d8-99f6-4f6a798559b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH22526',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 190329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': None,
 'title': 'Audi A6 2.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH22526%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Saving data for JH22526: {'auction_closing_time': 1774884614.0, 'created_time': 1774521744.473578, 'last_price_update_time': 1774723048.713879}
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH22526') HTTP/1.1" 204 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR60146%27 HTTP/1.1" 200 None
2026-03-28 18:37:28 [auto1.de] INFO: Scrape type for KR60146: 0
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-28 18:37:28 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-28 18:37:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:29 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT56964%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for AT56964: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG36008%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for UG36008: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM50766%27 HTTP/1.1" 200 None
2026-03-28 18:37:29 [auto1.de] INFO: Scrape type for TM50766: 0
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-28 18:37:29 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-28 18:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG62730%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for LG62730: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG50792%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for TG50792: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN67479%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for CN67479: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV45181%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for KV45181: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM30127%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for LM30127: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK47054%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for TK47054: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS50717%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for XS50717: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE74408%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for PE74408: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for VX15000: 2
2026-03-28 18:37:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with identifier: VX15000
2026-03-28 18:37:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with scrape type 2
2026-03-28 18:37:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with scrape type 2
2026-03-28 18:37:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f6e1b34-90a9-598e-8c77-d610d273f4b4, identifier: VX15000
2026-03-28 18:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with identifier: VX15000
2026-03-28 18:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with identifier: VX15000
2026-03-28 18:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f6e1b34-90a9-598e-8c77-d610d273f4b4 with identifier: VX15000 to the API
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:20:21Z',
 'fuel_type': 'diesel',
 'id': '9f6e1b34-90a9-598e-8c77-d610d273f4b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX15000',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 105992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX15000%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Saving data for VX15000: {'auction_closing_time': 1774884021.0, 'created_time': 1774636604.334317, 'last_price_update_time': 1774723050.557811}
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX15000') HTTP/1.1" 204 0
2026-03-28 18:37:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW09760%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for RW09760: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC75051%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for CC75051: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK73067%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for WK73067: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR29242%27 HTTP/1.1" 200 None
2026-03-28 18:37:30 [auto1.de] INFO: Scrape type for TR29242: 0
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-28 18:37:30 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-28 18:37:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:31 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN99160%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for BN99160: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH74831%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for EH74831: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK28238%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for ZK28238: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05980%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for XE05980: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND58698%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for ND58698: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM28513%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for NM28513: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB05774%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for NB05774: 0
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-28 18:37:31 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-28 18:37:31 [auto1.de] INFO: Scrape type for YM60509: 2
2026-03-28 18:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d1372f1-daf7-5393-84d2-6558cf8347e5 with identifier: YM60509
2026-03-28 18:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d1372f1-daf7-5393-84d2-6558cf8347e5 with scrape type 2
2026-03-28 18:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d1372f1-daf7-5393-84d2-6558cf8347e5 with scrape type 2
2026-03-28 18:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d1372f1-daf7-5393-84d2-6558cf8347e5, identifier: YM60509
2026-03-28 18:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d1372f1-daf7-5393-84d2-6558cf8347e5 with identifier: YM60509
2026-03-28 18:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d1372f1-daf7-5393-84d2-6558cf8347e5 with identifier: YM60509
2026-03-28 18:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d1372f1-daf7-5393-84d2-6558cf8347e5 with identifier: YM60509 to the API
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'petrol',
 'id': '9d1372f1-daf7-5393-84d2-6558cf8347e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM60509',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 86042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM60509%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Saving data for YM60509: {'auction_closing_time': 1774882807.0, 'created_time': 1774522110.049694, 'last_price_update_time': 1774723052.311984}
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM60509') HTTP/1.1" 204 0
2026-03-28 18:37:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA69467%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for HA69467: 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for XK59182: 2
2026-03-28 18:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: add08cfe-4aa1-56ed-9e24-2b5175520a73 with identifier: XK59182
2026-03-28 18:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item add08cfe-4aa1-56ed-9e24-2b5175520a73 with scrape type 2
2026-03-28 18:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item add08cfe-4aa1-56ed-9e24-2b5175520a73 with scrape type 2
2026-03-28 18:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: add08cfe-4aa1-56ed-9e24-2b5175520a73, identifier: XK59182
2026-03-28 18:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: add08cfe-4aa1-56ed-9e24-2b5175520a73 with identifier: XK59182
2026-03-28 18:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: add08cfe-4aa1-56ed-9e24-2b5175520a73 with identifier: XK59182
2026-03-28 18:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: add08cfe-4aa1-56ed-9e24-2b5175520a73 with identifier: XK59182 to the API
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 328,
 'expiration_date': '2026-03-30T15:37:20Z',
 'fuel_type': 'petrol',
 'id': 'add08cfe-4aa1-56ed-9e24-2b5175520a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK59182',
 'listing': 'auction',
 'make': 'Nissan',
 'model': '370 Z',
 'odometer': 68857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-01',
 'seller_name': None,
 'title': 'Nissan 370 Z 3.7 V6 Roadster Pack',
 'transmission': 'manual',
 'trim': 'Roadster Pack',
 'year': 2015}
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK59182%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Saving data for XK59182: {'auction_closing_time': 1774885040.0, 'created_time': 1774521246.306808, 'last_price_update_time': 1774723052.902727}
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK59182') HTTP/1.1" 204 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13561%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for EA13561: 0
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-28 18:37:32 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-28 18:37:32 [auto1.de] INFO: Scrape type for GT00768: 2
2026-03-28 18:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with identifier: GT00768
2026-03-28 18:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with scrape type 2
2026-03-28 18:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with scrape type 2
2026-03-28 18:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 567c8caf-ea6d-5941-9aa1-a05e879c82e0, identifier: GT00768
2026-03-28 18:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with identifier: GT00768
2026-03-28 18:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with identifier: GT00768
2026-03-28 18:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 567c8caf-ea6d-5941-9aa1-a05e879c82e0 with identifier: GT00768 to the API
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:02:32Z',
 'fuel_type': 'petrol',
 'id': '567c8caf-ea6d-5941-9aa1-a05e879c82e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT00768',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 87830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-09',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT00768%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Saving data for GT00768: {'auction_closing_time': 1774882952.0, 'created_time': 1773428036.089805, 'last_price_update_time': 1774723053.383324}
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT00768') HTTP/1.1" 204 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX61886%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for DX61886: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL30875%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for UL30875: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG91001%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for SG91001: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS21206%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for YS21206: 0
2026-03-28 18:37:33 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Scrape type for MR38870: 2
2026-03-28 18:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 925fe307-61b1-578f-910b-43f985bb1dd5 with identifier: MR38870
2026-03-28 18:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 925fe307-61b1-578f-910b-43f985bb1dd5 with scrape type 2
2026-03-28 18:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 925fe307-61b1-578f-910b-43f985bb1dd5 with scrape type 2
2026-03-28 18:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 925fe307-61b1-578f-910b-43f985bb1dd5, identifier: MR38870
2026-03-28 18:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 925fe307-61b1-578f-910b-43f985bb1dd5 with identifier: MR38870
2026-03-28 18:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 925fe307-61b1-578f-910b-43f985bb1dd5 with identifier: MR38870
2026-03-28 18:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 925fe307-61b1-578f-910b-43f985bb1dd5 with identifier: MR38870 to the API
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:46:46Z',
 'fuel_type': 'petrol',
 'id': '925fe307-61b1-578f-910b-43f985bb1dd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR38870',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 203593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-21',
 'seller_name': None,
 'title': 'Opel Insignia 1.6 Turbo Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR38870%27 HTTP/1.1" 200 None
2026-03-28 18:37:33 [auto1.de] INFO: Saving data for MR38870: {'auction_closing_time': 1774885606.0, 'created_time': 1774521665.686118, 'last_price_update_time': 1774723053.924187}
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR38870') HTTP/1.1" 204 0
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Scrape type for ZN01973: 2
2026-03-28 18:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with identifier: ZN01973
2026-03-28 18:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with scrape type 2
2026-03-28 18:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with scrape type 2
2026-03-28 18:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6, identifier: ZN01973
2026-03-28 18:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with identifier: ZN01973
2026-03-28 18:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with identifier: ZN01973
2026-03-28 18:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a5099c9-aaf5-5cff-b340-cc4b0e508db6 with identifier: ZN01973 to the API
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:46:20Z',
 'fuel_type': 'petrol',
 'id': '0a5099c9-aaf5-5cff-b340-cc4b0e508db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN01973',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 148458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-17',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Sendo',
 'transmission': 'manual',
 'trim': 'Sendo',
 'year': 2014}
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN01973%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Saving data for ZN01973: {'auction_closing_time': 1774885580.0, 'created_time': 1774521251.00514, 'last_price_update_time': 1774723054.517451}
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN01973') HTTP/1.1" 204 0
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD79531%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Scrape type for LD79531: 0
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67119%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Scrape type for VY67119: 0
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX52309%27 HTTP/1.1" 200 None
2026-03-28 18:37:34 [auto1.de] INFO: Scrape type for UX52309: 0
2026-03-28 18:37:34 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-28 18:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:35 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH24339%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for MH24339: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for PT52067: 2
2026-03-28 18:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-03-28 18:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 283b5831-7161-5609-a054-c35120bd52ec with scrape type 2
2026-03-28 18:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 283b5831-7161-5609-a054-c35120bd52ec with scrape type 2
2026-03-28 18:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 283b5831-7161-5609-a054-c35120bd52ec, identifier: PT52067
2026-03-28 18:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-03-28 18:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067
2026-03-28 18:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 283b5831-7161-5609-a054-c35120bd52ec with identifier: PT52067 to the API
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:15Z',
 'fuel_type': 'diesel',
 'id': '283b5831-7161-5609-a054-c35120bd52ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT52067',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 246115,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-18',
 'seller_name': None,
 'title': 'BMW 4er 418d Gran Coupé M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT52067%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Saving data for PT52067: {'auction_closing_time': 1774883235.0, 'created_time': 1774636338.802791, 'last_price_update_time': 1774723055.851784}
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT52067') HTTP/1.1" 204 0
2026-03-28 18:37:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD63966%27 HTTP/1.1" 200 None
2026-03-28 18:37:35 [auto1.de] INFO: Scrape type for LD63966: 0
2026-03-28 18:37:35 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS74936%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for XS74936: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX71275%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for PX71275: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC44311%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for EC44311: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV17454%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for TV17454: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB49272%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for AB49272: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP44038%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for BP44038: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED19748%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for ED19748: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG11243%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for LG11243: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71101%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for GJ71101: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG37948%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for NG37948: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG27070%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for GG27070: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS33010%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for GS33010: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA95146%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for UA95146: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC84625%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for RC84625: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP81367%27 HTTP/1.1" 200 None
2026-03-28 18:37:36 [auto1.de] INFO: Scrape type for WP81367: 0
2026-03-28 18:37:36 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-28 18:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:38 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB99961%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for PB99961: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF40931%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for VF40931: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for HD35365: 2
2026-03-28 18:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db112f04-e76c-5ac9-99b9-8f698c1c398d with identifier: HD35365
2026-03-28 18:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db112f04-e76c-5ac9-99b9-8f698c1c398d with scrape type 2
2026-03-28 18:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db112f04-e76c-5ac9-99b9-8f698c1c398d with scrape type 2
2026-03-28 18:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db112f04-e76c-5ac9-99b9-8f698c1c398d, identifier: HD35365
2026-03-28 18:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db112f04-e76c-5ac9-99b9-8f698c1c398d with identifier: HD35365
2026-03-28 18:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db112f04-e76c-5ac9-99b9-8f698c1c398d with identifier: HD35365
2026-03-28 18:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db112f04-e76c-5ac9-99b9-8f698c1c398d with identifier: HD35365 to the API
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:11:58Z',
 'fuel_type': 'diesel',
 'id': 'db112f04-e76c-5ac9-99b9-8f698c1c398d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD35365',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188997,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2015}
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD35365%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Saving data for HD35365: {'auction_closing_time': 1774883518.0, 'created_time': 1773301154.013313, 'last_price_update_time': 1774723058.689862}
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD35365') HTTP/1.1" 204 0
2026-03-28 18:37:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS86742%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for VS86742: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC05156%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for GC05156: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC36574%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for WC36574: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU13937%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for CU13937: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT67181%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for YT67181: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS66521%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for HS66521: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL30880%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for GL30880: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU26229%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for PU26229: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF63164%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for ZF63164: 0
2026-03-28 18:37:38 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-28 18:37:38 [auto1.de] INFO: Scrape type for SR33990: 2
2026-03-28 18:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a695526-cbfd-5f8e-8175-16e15330fbfc with identifier: SR33990
2026-03-28 18:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a695526-cbfd-5f8e-8175-16e15330fbfc with scrape type 2
2026-03-28 18:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a695526-cbfd-5f8e-8175-16e15330fbfc with scrape type 2
2026-03-28 18:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a695526-cbfd-5f8e-8175-16e15330fbfc, identifier: SR33990
2026-03-28 18:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a695526-cbfd-5f8e-8175-16e15330fbfc with identifier: SR33990
2026-03-28 18:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a695526-cbfd-5f8e-8175-16e15330fbfc with identifier: SR33990
2026-03-28 18:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a695526-cbfd-5f8e-8175-16e15330fbfc with identifier: SR33990 to the API
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:54:47Z',
 'fuel_type': 'diesel',
 'id': '2a695526-cbfd-5f8e-8175-16e15330fbfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR33990',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 168607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-07',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR33990%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Saving data for SR33990: {'auction_closing_time': 1774886087.0, 'created_time': 1774521161.311577, 'last_price_update_time': 1774723059.446036}
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR33990') HTTP/1.1" 204 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM00936%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for GM00936: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA09266%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for MA09266: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF13899%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for NF13899: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW93776%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for RW93776: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD88360%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for SD88360: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK21596%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for EK21596: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL42173%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for TL42173: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36203%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for EC36203: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU13127%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for PU13127: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX31179%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for XX31179: 0
2026-03-28 18:37:39 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-28 18:37:39 [auto1.de] INFO: Scrape type for DF28851: 2
2026-03-28 18:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f405cc-8529-53ae-98e0-56716de9a35d with identifier: DF28851
2026-03-28 18:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f405cc-8529-53ae-98e0-56716de9a35d with scrape type 2
2026-03-28 18:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f405cc-8529-53ae-98e0-56716de9a35d with scrape type 2
2026-03-28 18:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7f405cc-8529-53ae-98e0-56716de9a35d, identifier: DF28851
2026-03-28 18:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7f405cc-8529-53ae-98e0-56716de9a35d with identifier: DF28851
2026-03-28 18:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7f405cc-8529-53ae-98e0-56716de9a35d with identifier: DF28851
2026-03-28 18:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7f405cc-8529-53ae-98e0-56716de9a35d with identifier: DF28851 to the API
2026-03-28 18:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:14:21Z',
 'fuel_type': 'petrol',
 'id': 'a7f405cc-8529-53ae-98e0-56716de9a35d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF28851',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 62667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-29',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 TGDI GT",
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2020}
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF28851%27 HTTP/1.1" 200 None
2026-03-28 18:37:40 [auto1.de] INFO: Saving data for DF28851: {'auction_closing_time': 1774883661.0, 'created_time': 1773226845.565927, 'last_price_update_time': 1774723060.19722}
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF28851') HTTP/1.1" 204 0
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-28 18:37:40 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC83378%27 HTTP/1.1" 200 None
2026-03-28 18:37:40 [auto1.de] INFO: Scrape type for UC83378: 0
2026-03-28 18:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:41 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW22662%27 HTTP/1.1" 200 None
2026-03-28 18:37:41 [auto1.de] INFO: Scrape type for MW22662: 0
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU75285%27 HTTP/1.1" 200 None
2026-03-28 18:37:41 [auto1.de] INFO: Scrape type for LU75285: 0
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF68220%27 HTTP/1.1" 200 None
2026-03-28 18:37:41 [auto1.de] INFO: Scrape type for CF68220: 0
2026-03-28 18:37:41 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-28 18:37:41 [auto1.de] INFO: Scrape type for ZA74026: 2
2026-03-28 18:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcfef345-1b32-5cb8-9ff0-611c2dcef261 with identifier: ZA74026
2026-03-28 18:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcfef345-1b32-5cb8-9ff0-611c2dcef261 with scrape type 2
2026-03-28 18:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcfef345-1b32-5cb8-9ff0-611c2dcef261 with scrape type 2
2026-03-28 18:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dcfef345-1b32-5cb8-9ff0-611c2dcef261, identifier: ZA74026
2026-03-28 18:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dcfef345-1b32-5cb8-9ff0-611c2dcef261 with identifier: ZA74026
2026-03-28 18:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dcfef345-1b32-5cb8-9ff0-611c2dcef261 with identifier: ZA74026
2026-03-28 18:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dcfef345-1b32-5cb8-9ff0-611c2dcef261 with identifier: ZA74026 to the API
2026-03-28 18:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:46:31Z',
 'fuel_type': 'petrol',
 'id': 'dcfef345-1b32-5cb8-9ff0-611c2dcef261',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA74026',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 101539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-07',
 'seller_name': None,
 'title': 'Volkswagen Polo 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2018}
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA74026%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Saving data for ZA74026: {'auction_closing_time': 1774885591.0, 'created_time': 1774521541.200776, 'last_price_update_time': 1774723062.212859}
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA74026') HTTP/1.1" 204 0
2026-03-28 18:37:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC58383%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for EC58383: 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for GB76211: 2
2026-03-28 18:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8477624-4cce-54d0-8fe2-58bf0385166e with identifier: GB76211
2026-03-28 18:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8477624-4cce-54d0-8fe2-58bf0385166e with scrape type 2
2026-03-28 18:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8477624-4cce-54d0-8fe2-58bf0385166e with scrape type 2
2026-03-28 18:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8477624-4cce-54d0-8fe2-58bf0385166e, identifier: GB76211
2026-03-28 18:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8477624-4cce-54d0-8fe2-58bf0385166e with identifier: GB76211
2026-03-28 18:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8477624-4cce-54d0-8fe2-58bf0385166e with identifier: GB76211
2026-03-28 18:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8477624-4cce-54d0-8fe2-58bf0385166e with identifier: GB76211 to the API
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:19:07Z',
 'fuel_type': 'diesel',
 'id': 'f8477624-4cce-54d0-8fe2-58bf0385166e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB76211',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 74638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-19',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2013}
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB76211%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Saving data for GB76211: {'auction_closing_time': 1774883947.0, 'created_time': 1774636603.288018, 'last_price_update_time': 1774723062.698372}
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB76211') HTTP/1.1" 204 0
2026-03-28 18:37:42 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-28 18:37:42 [auto1.de] INFO: Scrape type for SP00408: 2
2026-03-28 18:37:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with identifier: SP00408
2026-03-28 18:37:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with scrape type 2
2026-03-28 18:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with scrape type 2
2026-03-28 18:37:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7eb6064f-a88c-5a7d-94e9-64bdda550d85, identifier: SP00408
2026-03-28 18:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with identifier: SP00408
2026-03-28 18:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with identifier: SP00408
2026-03-28 18:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7eb6064f-a88c-5a7d-94e9-64bdda550d85 with identifier: SP00408 to the API
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:24:31Z',
 'fuel_type': 'petrol',
 'id': '7eb6064f-a88c-5a7d-94e9-64bdda550d85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP00408',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 79868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP00408%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Saving data for SP00408: {'auction_closing_time': 1774884271.0, 'created_time': 1774118724.223235, 'last_price_update_time': 1774723063.241869}
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP00408') HTTP/1.1" 204 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for GC30737: 2
2026-03-28 18:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 434cafca-5dd2-5817-b3f8-0170e0166b93 with identifier: GC30737
2026-03-28 18:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 434cafca-5dd2-5817-b3f8-0170e0166b93 with scrape type 2
2026-03-28 18:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 434cafca-5dd2-5817-b3f8-0170e0166b93 with scrape type 2
2026-03-28 18:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 434cafca-5dd2-5817-b3f8-0170e0166b93, identifier: GC30737
2026-03-28 18:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 434cafca-5dd2-5817-b3f8-0170e0166b93 with identifier: GC30737
2026-03-28 18:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 434cafca-5dd2-5817-b3f8-0170e0166b93 with identifier: GC30737
2026-03-28 18:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 434cafca-5dd2-5817-b3f8-0170e0166b93 with identifier: GC30737 to the API
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:08:34Z',
 'fuel_type': 'petrol',
 'id': '434cafca-5dd2-5817-b3f8-0170e0166b93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC30737',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 156789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'BMW 3er 320i GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC30737%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Saving data for GC30737: {'auction_closing_time': 1774883314.0, 'created_time': 1774118777.473261, 'last_price_update_time': 1774723063.685896}
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC30737') HTTP/1.1" 204 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77146%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for HL77146: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM06695%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for TM06695: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR58128%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for XR58128: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST45837%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for ST45837: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU44330%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for MU44330: 0
2026-03-28 18:37:43 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-28 18:37:43 [auto1.de] INFO: Scrape type for JU26227: 2
2026-03-28 18:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbf5d9d-21db-5905-8cef-1fb6348cf837 with identifier: JU26227
2026-03-28 18:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbf5d9d-21db-5905-8cef-1fb6348cf837 with scrape type 2
2026-03-28 18:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbf5d9d-21db-5905-8cef-1fb6348cf837 with scrape type 2
2026-03-28 18:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbf5d9d-21db-5905-8cef-1fb6348cf837, identifier: JU26227
2026-03-28 18:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbf5d9d-21db-5905-8cef-1fb6348cf837 with identifier: JU26227
2026-03-28 18:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbf5d9d-21db-5905-8cef-1fb6348cf837 with identifier: JU26227
2026-03-28 18:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbf5d9d-21db-5905-8cef-1fb6348cf837 with identifier: JU26227 to the API
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:04:46Z',
 'fuel_type': 'diesel',
 'id': 'cdbf5d9d-21db-5905-8cef-1fb6348cf837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JU26227',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 361466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-22',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend Edition',
 'transmission': 'automatic',
 'trim': 'lang Trend Edition',
 'year': 2013}
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU26227%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Saving data for JU26227: {'auction_closing_time': 1774883086.0, 'created_time': 1774089050.747313, 'last_price_update_time': 1774723064.227288}
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JU26227') HTTP/1.1" 204 0
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for GV67460: 2
2026-03-28 18:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbecd5be-17dc-53d0-8010-e3df9787376c with identifier: GV67460
2026-03-28 18:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbecd5be-17dc-53d0-8010-e3df9787376c with scrape type 2
2026-03-28 18:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbecd5be-17dc-53d0-8010-e3df9787376c with scrape type 2
2026-03-28 18:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbecd5be-17dc-53d0-8010-e3df9787376c, identifier: GV67460
2026-03-28 18:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbecd5be-17dc-53d0-8010-e3df9787376c with identifier: GV67460
2026-03-28 18:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbecd5be-17dc-53d0-8010-e3df9787376c with identifier: GV67460
2026-03-28 18:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbecd5be-17dc-53d0-8010-e3df9787376c with identifier: GV67460 to the API
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:34Z',
 'fuel_type': 'diesel',
 'id': 'bbecd5be-17dc-53d0-8010-e3df9787376c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV67460',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 189845,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-31',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2003}
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV67460%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Saving data for GV67460: {'auction_closing_time': 1774885474.0, 'created_time': 1774089166.279476, 'last_price_update_time': 1774723064.78782}
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV67460') HTTP/1.1" 204 0
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ17394%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for NZ17394: 0
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA68492%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for YA68492: 0
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH92253%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for GH92253: 0
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT94173%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for VT94173: 0
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-28 18:37:44 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-28 18:37:44 [auto1.de] INFO: Scrape type for MY90175: 2
2026-03-28 18:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd55e608-d211-5e90-8cd1-18189c1791c0 with identifier: MY90175
2026-03-28 18:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd55e608-d211-5e90-8cd1-18189c1791c0 with scrape type 2
2026-03-28 18:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd55e608-d211-5e90-8cd1-18189c1791c0 with scrape type 2
2026-03-28 18:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd55e608-d211-5e90-8cd1-18189c1791c0, identifier: MY90175
2026-03-28 18:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd55e608-d211-5e90-8cd1-18189c1791c0 with identifier: MY90175
2026-03-28 18:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd55e608-d211-5e90-8cd1-18189c1791c0 with identifier: MY90175
2026-03-28 18:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd55e608-d211-5e90-8cd1-18189c1791c0 with identifier: MY90175 to the API
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:19:29Z',
 'fuel_type': 'petrol',
 'id': 'fd55e608-d211-5e90-8cd1-18189c1791c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY90175',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 41278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY90175%27 HTTP/1.1" 200 None
2026-03-28 18:37:45 [auto1.de] INFO: Saving data for MY90175: {'auction_closing_time': 1774883969.0, 'created_time': 1774521878.501841, 'last_price_update_time': 1774723065.318891}
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY90175') HTTP/1.1" 204 0
2026-03-28 18:37:45 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-28 18:37:45 [auto1.de] INFO: Scrape type for NH48980: 1
2026-03-28 18:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:46 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Scrape type for UZ14919: 2
2026-03-28 18:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b51ed3f0-14e6-50a0-90b4-95077e501314 with identifier: UZ14919
2026-03-28 18:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b51ed3f0-14e6-50a0-90b4-95077e501314 with scrape type 2
2026-03-28 18:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b51ed3f0-14e6-50a0-90b4-95077e501314 with scrape type 2
2026-03-28 18:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b51ed3f0-14e6-50a0-90b4-95077e501314, identifier: UZ14919
2026-03-28 18:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b51ed3f0-14e6-50a0-90b4-95077e501314 with identifier: UZ14919
2026-03-28 18:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b51ed3f0-14e6-50a0-90b4-95077e501314 with identifier: UZ14919
2026-03-28 18:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b51ed3f0-14e6-50a0-90b4-95077e501314 with identifier: UZ14919 to the API
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:55:43Z',
 'fuel_type': 'petrol',
 'id': 'b51ed3f0-14e6-50a0-90b4-95077e501314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ14919',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 150712,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-11',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ14919%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Saving data for UZ14919: {'auction_closing_time': 1774886143.0, 'created_time': 1773467677.789609, 'last_price_update_time': 1774723066.609642}
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ14919') HTTP/1.1" 204 0
2026-03-28 18:37:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-28 18:37:46 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-28 18:37:46 [auto1.de] INFO: Scrape type for KC56991: 2
2026-03-28 18:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with identifier: KC56991
2026-03-28 18:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with scrape type 2
2026-03-28 18:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with scrape type 2
2026-03-28 18:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b, identifier: KC56991
2026-03-28 18:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with identifier: KC56991
2026-03-28 18:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with identifier: KC56991
2026-03-28 18:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42ac30f8-832c-5d92-b6a6-b3829f0ea04b with identifier: KC56991 to the API
2026-03-28 18:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:55:35Z',
 'fuel_type': 'diesel',
 'id': '42ac30f8-832c-5d92-b6a6-b3829f0ea04b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC56991',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 159266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-26',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2015}
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC56991%27 HTTP/1.1" 200 None
2026-03-28 18:37:47 [auto1.de] INFO: Saving data for KC56991: {'auction_closing_time': 1774886135.0, 'created_time': 1774031880.84158, 'last_price_update_time': 1774723067.139305}
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC56991') HTTP/1.1" 204 0
2026-03-28 18:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH48980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-28 18:37:47 [auto1.de] INFO: Scrape type for SP37211: 2
2026-03-28 18:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb4523d6-941d-519e-b6f2-39392a99145b with identifier: SP37211
2026-03-28 18:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb4523d6-941d-519e-b6f2-39392a99145b with scrape type 2
2026-03-28 18:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb4523d6-941d-519e-b6f2-39392a99145b with scrape type 2
2026-03-28 18:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb4523d6-941d-519e-b6f2-39392a99145b, identifier: SP37211
2026-03-28 18:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb4523d6-941d-519e-b6f2-39392a99145b with identifier: SP37211
2026-03-28 18:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb4523d6-941d-519e-b6f2-39392a99145b with identifier: SP37211
2026-03-28 18:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb4523d6-941d-519e-b6f2-39392a99145b with identifier: SP37211 to the API
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:08:05Z',
 'fuel_type': 'diesel',
 'id': 'bb4523d6-941d-519e-b6f2-39392a99145b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP37211',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 166200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-03',
 'seller_name': None,
 'title': 'Kia Venga 1.6 CRDi Platinum Edition',
 'transmission': 'manual',
 'trim': 'Platinum Edition',
 'year': 2014}
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP37211%27 HTTP/1.1" 200 None
2026-03-28 18:37:47 [auto1.de] INFO: Saving data for SP37211: {'auction_closing_time': 1774883285.0, 'created_time': 1774002110.709302, 'last_price_update_time': 1774723067.603507}
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP37211') HTTP/1.1" 204 0
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-28 18:37:47 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-28 18:37:47 [auto1.de] INFO: Scrape type for ZJ20785: 2
2026-03-28 18:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 791be7a6-da4c-50d6-9bbb-b920c41babb7 with identifier: ZJ20785
2026-03-28 18:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 791be7a6-da4c-50d6-9bbb-b920c41babb7 with scrape type 2
2026-03-28 18:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 791be7a6-da4c-50d6-9bbb-b920c41babb7 with scrape type 2
2026-03-28 18:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 791be7a6-da4c-50d6-9bbb-b920c41babb7, identifier: ZJ20785
2026-03-28 18:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 791be7a6-da4c-50d6-9bbb-b920c41babb7 with identifier: ZJ20785
2026-03-28 18:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 791be7a6-da4c-50d6-9bbb-b920c41babb7 with identifier: ZJ20785
2026-03-28 18:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 791be7a6-da4c-50d6-9bbb-b920c41babb7 with identifier: ZJ20785 to the API
2026-03-28 18:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:09:43Z',
 'fuel_type': 'petrol',
 'id': '791be7a6-da4c-50d6-9bbb-b920c41babb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ20785',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 93166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-29',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 Trend 2WD',
 'transmission': 'manual',
 'trim': 'Trend 2WD',
 'year': 2014}
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ20785%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Saving data for ZJ20785: {'auction_closing_time': 1774883383.0, 'created_time': 1774034562.980507, 'last_price_update_time': 1774723068.149726}
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ20785') HTTP/1.1" 204 0
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for HJ15324: 2
2026-03-28 18:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 764cc605-b551-5d77-b757-5317bb0c70bd with identifier: HJ15324
2026-03-28 18:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 764cc605-b551-5d77-b757-5317bb0c70bd with scrape type 2
2026-03-28 18:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 764cc605-b551-5d77-b757-5317bb0c70bd with scrape type 2
2026-03-28 18:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 764cc605-b551-5d77-b757-5317bb0c70bd, identifier: HJ15324
2026-03-28 18:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 764cc605-b551-5d77-b757-5317bb0c70bd with identifier: HJ15324
2026-03-28 18:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 764cc605-b551-5d77-b757-5317bb0c70bd with identifier: HJ15324
2026-03-28 18:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 764cc605-b551-5d77-b757-5317bb0c70bd with identifier: HJ15324 to the API
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:34:02Z',
 'fuel_type': 'diesel',
 'id': '764cc605-b551-5d77-b757-5317bb0c70bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ15324',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 193970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'Ford Mondeo 1.6 TDCi Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2014}
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ15324%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Saving data for HJ15324: {'auction_closing_time': 1774884842.0, 'created_time': 1774377524.672996, 'last_price_update_time': 1774723068.601565}
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ15324') HTTP/1.1" 204 0
2026-03-28 18:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for NL79635: 1
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-28 18:37:48 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-28 18:37:48 [auto1.de] INFO: Scrape type for DP76469: 2
2026-03-28 18:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61cb4329-635a-52ce-9548-9eb289967e13 with identifier: DP76469
2026-03-28 18:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61cb4329-635a-52ce-9548-9eb289967e13 with scrape type 2
2026-03-28 18:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61cb4329-635a-52ce-9548-9eb289967e13 with scrape type 2
2026-03-28 18:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61cb4329-635a-52ce-9548-9eb289967e13, identifier: DP76469
2026-03-28 18:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61cb4329-635a-52ce-9548-9eb289967e13 with identifier: DP76469
2026-03-28 18:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61cb4329-635a-52ce-9548-9eb289967e13 with identifier: DP76469
2026-03-28 18:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61cb4329-635a-52ce-9548-9eb289967e13 with identifier: DP76469 to the API
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 398,
 'expiration_date': '2026-03-30T15:01:44Z',
 'fuel_type': 'hybrid',
 'id': '61cb4329-635a-52ce-9548-9eb289967e13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP76469',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 55010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-19',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T6 Recharge Plug-in Hybrid Plus Dark AWD',
 'transmission': 'automatic',
 'trim': 'Plus Dark AWD',
 'year': 2023}
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP76469%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Saving data for DP76469: {'auction_closing_time': 1774882904.0, 'created_time': 1774349249.990046, 'last_price_update_time': 1774723069.083338}
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP76469') HTTP/1.1" 204 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for LU20114: 2
2026-03-28 18:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cc88dcd-33e4-504f-8d73-653126e220a7 with identifier: LU20114
2026-03-28 18:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cc88dcd-33e4-504f-8d73-653126e220a7 with scrape type 2
2026-03-28 18:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cc88dcd-33e4-504f-8d73-653126e220a7 with scrape type 2
2026-03-28 18:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cc88dcd-33e4-504f-8d73-653126e220a7, identifier: LU20114
2026-03-28 18:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cc88dcd-33e4-504f-8d73-653126e220a7 with identifier: LU20114
2026-03-28 18:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cc88dcd-33e4-504f-8d73-653126e220a7 with identifier: LU20114
2026-03-28 18:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cc88dcd-33e4-504f-8d73-653126e220a7 with identifier: LU20114 to the API
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:38:32Z',
 'fuel_type': 'petrol',
 'id': '3cc88dcd-33e4-504f-8d73-653126e220a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU20114',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 100649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-27',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2013}
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU20114%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Saving data for LU20114: {'auction_closing_time': 1774885112.0, 'created_time': 1773402486.306377, 'last_price_update_time': 1774723069.669711}
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU20114') HTTP/1.1" 204 0
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-28 18:37:49 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-28 18:37:49 [auto1.de] INFO: Scrape type for MA38279: 2
2026-03-28 18:37:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with identifier: MA38279
2026-03-28 18:37:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with scrape type 2
2026-03-28 18:37:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with scrape type 2
2026-03-28 18:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89, identifier: MA38279
2026-03-28 18:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with identifier: MA38279
2026-03-28 18:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with identifier: MA38279
2026-03-28 18:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11bc6dc2-17bc-5e12-89c2-10d62d8d5b89 with identifier: MA38279 to the API
2026-03-28 18:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:12:08Z',
 'fuel_type': 'petrol',
 'id': '11bc6dc2-17bc-5e12-89c2-10d62d8d5b89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA38279',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 97135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-20',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 FIFA WM Edition',
 'transmission': 'manual',
 'trim': 'FIFA WM Edition',
 'year': 2011}
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA38279%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Saving data for MA38279: {'auction_closing_time': 1774883528.0, 'created_time': 1774032833.945117, 'last_price_update_time': 1774723070.127451}
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA38279') HTTP/1.1" 204 0
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Scrape type for PZ30496: 2
2026-03-28 18:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with identifier: PZ30496
2026-03-28 18:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with scrape type 2
2026-03-28 18:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with scrape type 2
2026-03-28 18:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a, identifier: PZ30496
2026-03-28 18:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with identifier: PZ30496
2026-03-28 18:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with identifier: PZ30496
2026-03-28 18:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab2078ff-555f-5d3c-90ff-3a1c8659cf1a with identifier: PZ30496 to the API
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:16:56Z',
 'fuel_type': 'diesel',
 'id': 'ab2078ff-555f-5d3c-90ff-3a1c8659cf1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ30496',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 46002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-25',
 'seller_name': None,
 'title': 'BMW X5 xDrive 25d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ30496%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Saving data for PZ30496: {'auction_closing_time': 1774883816.0, 'created_time': 1774002249.989397, 'last_price_update_time': 1774723070.565529}
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ30496') HTTP/1.1" 204 0
2026-03-28 18:37:50 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-28 18:37:50 [auto1.de] INFO: Scrape type for CH12661: 2
2026-03-28 18:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0489f933-f2e3-53b3-a14b-48b95e1af591 with identifier: CH12661
2026-03-28 18:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0489f933-f2e3-53b3-a14b-48b95e1af591 with scrape type 2
2026-03-28 18:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0489f933-f2e3-53b3-a14b-48b95e1af591 with scrape type 2
2026-03-28 18:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0489f933-f2e3-53b3-a14b-48b95e1af591, identifier: CH12661
2026-03-28 18:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0489f933-f2e3-53b3-a14b-48b95e1af591 with identifier: CH12661
2026-03-28 18:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0489f933-f2e3-53b3-a14b-48b95e1af591 with identifier: CH12661
2026-03-28 18:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0489f933-f2e3-53b3-a14b-48b95e1af591 with identifier: CH12661 to the API
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:12:40Z',
 'fuel_type': 'petrol',
 'id': '0489f933-f2e3-53b3-a14b-48b95e1af591',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH12661',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 177959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH12661%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Saving data for CH12661: {'auction_closing_time': 1774883560.0, 'created_time': 1774349924.881965, 'last_price_update_time': 1774723071.041359}
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CH12661') HTTP/1.1" 204 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for HC35889: 2
2026-03-28 18:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with identifier: HC35889
2026-03-28 18:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with scrape type 2
2026-03-28 18:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with scrape type 2
2026-03-28 18:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95, identifier: HC35889
2026-03-28 18:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with identifier: HC35889
2026-03-28 18:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with identifier: HC35889
2026-03-28 18:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c8643a1-4c8a-58a1-8bb5-64ccb749ad95 with identifier: HC35889 to the API
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:31:24Z',
 'fuel_type': 'diesel',
 'id': '6c8643a1-4c8a-58a1-8bb5-64ccb749ad95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC35889',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 175988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2012}
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC35889%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Saving data for HC35889: {'auction_closing_time': 1774884684.0, 'created_time': 1773304603.127408, 'last_price_update_time': 1774723071.491423}
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC35889') HTTP/1.1" 204 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Scrape type for ZM69821: 2
2026-03-28 18:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1024aae5-7b1d-523e-be36-42ee6c88b39c with identifier: ZM69821
2026-03-28 18:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1024aae5-7b1d-523e-be36-42ee6c88b39c with scrape type 2
2026-03-28 18:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1024aae5-7b1d-523e-be36-42ee6c88b39c with scrape type 2
2026-03-28 18:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1024aae5-7b1d-523e-be36-42ee6c88b39c, identifier: ZM69821
2026-03-28 18:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1024aae5-7b1d-523e-be36-42ee6c88b39c with identifier: ZM69821
2026-03-28 18:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1024aae5-7b1d-523e-be36-42ee6c88b39c with identifier: ZM69821
2026-03-28 18:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1024aae5-7b1d-523e-be36-42ee6c88b39c with identifier: ZM69821 to the API
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:31:46Z',
 'fuel_type': 'diesel',
 'id': '1024aae5-7b1d-523e-be36-42ee6c88b39c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM69821',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 159416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-22',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM69821%27 HTTP/1.1" 200 None
2026-03-28 18:37:51 [auto1.de] INFO: Saving data for ZM69821: {'auction_closing_time': 1774884706.0, 'created_time': 1774089100.684302, 'last_price_update_time': 1774723071.96085}
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM69821') HTTP/1.1" 204 0
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-28 18:37:51 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-28 18:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for KF80964: 2
2026-03-28 18:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 841be485-5981-58ed-922c-c83720fb6685 with identifier: KF80964
2026-03-28 18:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 841be485-5981-58ed-922c-c83720fb6685 with scrape type 2
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 841be485-5981-58ed-922c-c83720fb6685 with scrape type 2
2026-03-28 18:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 841be485-5981-58ed-922c-c83720fb6685, identifier: KF80964
2026-03-28 18:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH48980> (referer: https://www.auto1.com/v1/car-details-view/NH48980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NL79635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 841be485-5981-58ed-922c-c83720fb6685 with identifier: KF80964
2026-03-28 18:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 841be485-5981-58ed-922c-c83720fb6685 with identifier: KF80964
2026-03-28 18:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 841be485-5981-58ed-922c-c83720fb6685 with identifier: KF80964 to the API
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:51:32Z',
 'fuel_type': 'petrol',
 'id': '841be485-5981-58ed-922c-c83720fb6685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF80964',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 65593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-08',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2014}
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF80964%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Saving data for KF80964: {'auction_closing_time': 1774885892.0, 'created_time': 1773468622.268255, 'last_price_update_time': 1774723072.417086}
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KF80964') HTTP/1.1" 204 0
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for KR40526: 1
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for NS83554: 1
2026-03-28 18:37:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:52 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26ca1067-05ff-5237-9e43-12b34b062583 with identifier: NH48980
2026-03-28 18:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26ca1067-05ff-5237-9e43-12b34b062583 with scrape type 1
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26ca1067-05ff-5237-9e43-12b34b062583
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_1e21b41c24f0fb211920a6136f043db5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_1e21b41c24f0fb211920a6136f043db5.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_da2593c35cbfc35be0ccc987b5a286d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_da2593c35cbfc35be0ccc987b5a286d7.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_b4227485b7574b5b40cd97f5881daa8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_b4227485b7574b5b40cd97f5881daa8d.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_ae81665914f49c33ffa847bb5a3acae2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_ae81665914f49c33ffa847bb5a3acae2.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_b337f9075bd146c7d8cb26b7437555e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_b337f9075bd146c7d8cb26b7437555e1.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_9f2d6ffe02c1d7db803df9fa0787a677.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_9f2d6ffe02c1d7db803df9fa0787a677.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_3c5d3ec50aeed470e0375dc19e9b7894.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_3c5d3ec50aeed470e0375dc19e9b7894.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_dded44d1abf81efe3b66d764c5d8b06a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_dded44d1abf81efe3b66d764c5d8b06a.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_48a3a1e70b3e438c4564a922ea8da1b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_48a3a1e70b3e438c4564a922ea8da1b3.jpg already downloaded
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F6a%252Ffa6ab758e0ca8afee09408c0d6f9926d%252Fpa%252FNH48980_a56676084dd2731afd7c4fec572208cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_a56676084dd2731afd7c4fec572208cc.jpg already downloaded
2026-03-28 18:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26ca1067-05ff-5237-9e43-12b34b062583, identifier: NH48980
2026-03-28 18:37:52 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-28 18:37:52 [auto1.de] INFO: Scrape type for UV09635: 1
2026-03-28 18:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26ca1067-05ff-5237-9e43-12b34b062583 with identifier: NH48980
2026-03-28 18:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26ca1067-05ff-5237-9e43-12b34b062583 with identifier: NH48980
2026-03-28 18:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26ca1067-05ff-5237-9e43-12b34b062583 with identifier: NH48980 to the API
2026-03-28 18:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NH48980>
{'auction_title': '',
 'c_o_2_emission_value': 193,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.5L',
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:53:22Z',
 'fuel_type': 'petrol',
 'id': '26ca1067-05ff-5237-9e43-12b34b062583',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH48980',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 155872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_1e21b41c24f0fb211920a6136f043db5.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_da2593c35cbfc35be0ccc987b5a286d7.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_b4227485b7574b5b40cd97f5881daa8d.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_ae81665914f49c33ffa847bb5a3acae2.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_b337f9075bd146c7d8cb26b7437555e1.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_9f2d6ffe02c1d7db803df9fa0787a677.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_3c5d3ec50aeed470e0375dc19e9b7894.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_dded44d1abf81efe3b66d764c5d8b06a.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_48a3a1e70b3e438c4564a922ea8da1b3.jpg',
                'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_a56676084dd2731afd7c4fec572208cc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2628653,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_1e21b41c24f0fb211920a6136f043db5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_da2593c35cbfc35be0ccc987b5a286d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2872581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_b4227485b7574b5b40cd97f5881daa8d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_ae81665914f49c33ffa847bb5a3acae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2447801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_b337f9075bd146c7d8cb26b7437555e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_9f2d6ffe02c1d7db803df9fa0787a677.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2613892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_3c5d3ec50aeed470e0375dc19e9b7894.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2790680,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_dded44d1abf81efe3b66d764c5d8b06a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2534581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_48a3a1e70b3e438c4564a922ea8da1b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_26ca1067-05ff-5237-9e43-12b34b062583/26ca1067-05ff-5237-9e43-12b34b062583_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/6a/fa6ab758e0ca8afee09408c0d6f9926d/pa/NH48980_a56676084dd2731afd7c4fec572208cc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 350 CGI L 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'L 4Matic BlueEfficiency',
 'year': 2011}
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH48980%27 HTTP/1.1" 200 None
2026-03-28 18:37:53 [auto1.de] INFO: Saving data for NH48980: {'created_time': 1774723073.243849, 'last_price_update_time': 1774723073.243861, 'auction_closing_time': 1774886002.0}
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH48980') HTTP/1.1" 204 0
2026-03-28 18:37:53 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-28 18:37:53 [auto1.de] INFO: Scrape type for EX09851: 2
2026-03-28 18:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0965f22-7074-578c-ab13-b8c62dfc7c62 with identifier: EX09851
2026-03-28 18:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0965f22-7074-578c-ab13-b8c62dfc7c62 with scrape type 2
2026-03-28 18:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0965f22-7074-578c-ab13-b8c62dfc7c62 with scrape type 2
2026-03-28 18:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0965f22-7074-578c-ab13-b8c62dfc7c62, identifier: EX09851
2026-03-28 18:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:53 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-28 18:37:53 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-28 18:37:53 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-28 18:37:53 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-28 18:37:53 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-28 18:37:53 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-28 18:37:53 [auto1.de] INFO: Scrape type for LR83897: 2
2026-03-28 18:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e953707-1cb1-5ce1-86ad-850864e2fbfd with identifier: LR83897
2026-03-28 18:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e953707-1cb1-5ce1-86ad-850864e2fbfd with scrape type 2
2026-03-28 18:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e953707-1cb1-5ce1-86ad-850864e2fbfd with scrape type 2
2026-03-28 18:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e953707-1cb1-5ce1-86ad-850864e2fbfd, identifier: LR83897
2026-03-28 18:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0965f22-7074-578c-ab13-b8c62dfc7c62 with identifier: EX09851
2026-03-28 18:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0965f22-7074-578c-ab13-b8c62dfc7c62 with identifier: EX09851
2026-03-28 18:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0965f22-7074-578c-ab13-b8c62dfc7c62 with identifier: EX09851 to the API
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:16:26Z',
 'fuel_type': 'diesel',
 'id': 'a0965f22-7074-578c-ab13-b8c62dfc7c62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX09851',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 146554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-12',
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel Classic',
 'transmission': 'manual',
 'trim': 'Travel Classic',
 'year': 2017}
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX09851%27 HTTP/1.1" 200 None
2026-03-28 18:37:53 [auto1.de] INFO: Saving data for EX09851: {'auction_closing_time': 1774883786.0, 'created_time': 1774349356.439792, 'last_price_update_time': 1774723073.788132}
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX09851') HTTP/1.1" 204 0
2026-03-28 18:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e953707-1cb1-5ce1-86ad-850864e2fbfd with identifier: LR83897
2026-03-28 18:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e953707-1cb1-5ce1-86ad-850864e2fbfd with identifier: LR83897
2026-03-28 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e953707-1cb1-5ce1-86ad-850864e2fbfd with identifier: LR83897 to the API
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:18:19Z',
 'fuel_type': 'diesel',
 'id': '6e953707-1cb1-5ce1-86ad-850864e2fbfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR83897',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 191360,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2016}
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR83897%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Saving data for LR83897: {'auction_closing_time': 1774883899.0, 'created_time': 1773467067.234613, 'last_price_update_time': 1774723074.23776}
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR83897') HTTP/1.1" 204 0
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for RT47788: 2
2026-03-28 18:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 184f3a56-3b8e-57f7-976b-d899593a4628 with identifier: RT47788
2026-03-28 18:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 184f3a56-3b8e-57f7-976b-d899593a4628 with scrape type 2
2026-03-28 18:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 184f3a56-3b8e-57f7-976b-d899593a4628 with scrape type 2
2026-03-28 18:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 184f3a56-3b8e-57f7-976b-d899593a4628, identifier: RT47788
2026-03-28 18:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 184f3a56-3b8e-57f7-976b-d899593a4628 with identifier: RT47788
2026-03-28 18:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 184f3a56-3b8e-57f7-976b-d899593a4628 with identifier: RT47788
2026-03-28 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 184f3a56-3b8e-57f7-976b-d899593a4628 with identifier: RT47788 to the API
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:35:39Z',
 'fuel_type': 'diesel',
 'id': '184f3a56-3b8e-57f7-976b-d899593a4628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT47788',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 344253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2014}
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47788%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Saving data for RT47788: {'auction_closing_time': 1774884939.0, 'created_time': 1774118857.964236, 'last_price_update_time': 1774723074.733505}
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT47788') HTTP/1.1" 204 0
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-28 18:37:54 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-28 18:37:54 [auto1.de] INFO: Scrape type for NF65308: 2
2026-03-28 18:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce0747f5-684c-5e9a-a887-2fd8983d1233 with identifier: NF65308
2026-03-28 18:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce0747f5-684c-5e9a-a887-2fd8983d1233 with scrape type 2
2026-03-28 18:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce0747f5-684c-5e9a-a887-2fd8983d1233 with scrape type 2
2026-03-28 18:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce0747f5-684c-5e9a-a887-2fd8983d1233, identifier: NF65308
2026-03-28 18:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce0747f5-684c-5e9a-a887-2fd8983d1233 with identifier: NF65308
2026-03-28 18:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce0747f5-684c-5e9a-a887-2fd8983d1233 with identifier: NF65308
2026-03-28 18:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce0747f5-684c-5e9a-a887-2fd8983d1233 with identifier: NF65308 to the API
2026-03-28 18:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:57:26Z',
 'fuel_type': 'petrol',
 'id': 'ce0747f5-684c-5e9a-a887-2fd8983d1233',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF65308',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Taigo',
 'odometer': 14487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-03-04',
 'seller_name': None,
 'title': 'Volkswagen Taigo 1.0 TSI Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2025}
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65308%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Saving data for NF65308: {'auction_closing_time': 1774886246.0, 'created_time': 1773340797.105527, 'last_price_update_time': 1774723075.201708}
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF65308') HTTP/1.1" 204 0
2026-03-28 18:37:55 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Scrape type for RB21288: 2
2026-03-28 18:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e818fd-0152-593b-a5f6-487cc7b64ddf with identifier: RB21288
2026-03-28 18:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e818fd-0152-593b-a5f6-487cc7b64ddf with scrape type 2
2026-03-28 18:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e818fd-0152-593b-a5f6-487cc7b64ddf with scrape type 2
2026-03-28 18:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47e818fd-0152-593b-a5f6-487cc7b64ddf, identifier: RB21288
2026-03-28 18:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47e818fd-0152-593b-a5f6-487cc7b64ddf with identifier: RB21288
2026-03-28 18:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47e818fd-0152-593b-a5f6-487cc7b64ddf with identifier: RB21288
2026-03-28 18:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47e818fd-0152-593b-a5f6-487cc7b64ddf with identifier: RB21288 to the API
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:56:08Z',
 'fuel_type': 'petrol',
 'id': '47e818fd-0152-593b-a5f6-487cc7b64ddf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB21288',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 126649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-02',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Attract 2WD',
 'transmission': 'automatic',
 'trim': 'Attract 2WD',
 'year': 2013}
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB21288%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Saving data for RB21288: {'auction_closing_time': 1774886168.0, 'created_time': 1774031847.233546, 'last_price_update_time': 1774723075.639577}
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB21288') HTTP/1.1" 204 0
2026-03-28 18:37:55 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-28 18:37:55 [auto1.de] INFO: Scrape type for TL00985: 2
2026-03-28 18:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77504561-d8c1-58a9-aaac-8bc5f00f10cf with identifier: TL00985
2026-03-28 18:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77504561-d8c1-58a9-aaac-8bc5f00f10cf with scrape type 2
2026-03-28 18:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77504561-d8c1-58a9-aaac-8bc5f00f10cf with scrape type 2
2026-03-28 18:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77504561-d8c1-58a9-aaac-8bc5f00f10cf, identifier: TL00985
2026-03-28 18:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77504561-d8c1-58a9-aaac-8bc5f00f10cf with identifier: TL00985
2026-03-28 18:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77504561-d8c1-58a9-aaac-8bc5f00f10cf with identifier: TL00985
2026-03-28 18:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77504561-d8c1-58a9-aaac-8bc5f00f10cf with identifier: TL00985 to the API
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 349,
 'expiration_date': '2026-03-30T15:15:57Z',
 'fuel_type': 'diesel',
 'id': '77504561-d8c1-58a9-aaac-8bc5f00f10cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL00985',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 187449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seller_name': None,
 'title': 'Audi A6 Allroad 55 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL00985%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Saving data for TL00985: {'auction_closing_time': 1774883757.0, 'created_time': 1773468822.353858, 'last_price_update_time': 1774723076.110788}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL00985') HTTP/1.1" 204 0
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Scrape type for SM64754: 2
2026-03-28 18:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89b085ca-8805-547a-b684-ece7b3cfc007 with identifier: SM64754
2026-03-28 18:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89b085ca-8805-547a-b684-ece7b3cfc007 with scrape type 2
2026-03-28 18:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89b085ca-8805-547a-b684-ece7b3cfc007 with scrape type 2
2026-03-28 18:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 89b085ca-8805-547a-b684-ece7b3cfc007, identifier: SM64754
2026-03-28 18:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 89b085ca-8805-547a-b684-ece7b3cfc007 with identifier: SM64754
2026-03-28 18:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 89b085ca-8805-547a-b684-ece7b3cfc007 with identifier: SM64754
2026-03-28 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 89b085ca-8805-547a-b684-ece7b3cfc007 with identifier: SM64754 to the API
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:54:01Z',
 'fuel_type': 'petrol',
 'id': '89b085ca-8805-547a-b684-ece7b3cfc007',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM64754',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Karl',
 'odometer': 40873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Opel Karl 1.0 Rocks',
 'transmission': 'manual',
 'trim': 'Rocks',
 'year': 2017}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM64754%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Saving data for SM64754: {'auction_closing_time': 1774886041.0, 'created_time': 1774033694.071387, 'last_price_update_time': 1774723076.57884}
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM64754') HTTP/1.1" 204 0
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Scrape type for PL66942: 1
2026-03-28 18:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KR40526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-28 18:37:56 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-28 18:37:56 [auto1.de] INFO: Scrape type for RU39212: 2
2026-03-28 18:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with identifier: RU39212
2026-03-28 18:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with scrape type 2
2026-03-28 18:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with scrape type 2
2026-03-28 18:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96, identifier: RU39212
2026-03-28 18:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with identifier: RU39212
2026-03-28 18:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with identifier: RU39212
2026-03-28 18:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ce1cd3a-eb83-5823-966f-6aa3e60d8e96 with identifier: RU39212 to the API
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:01Z',
 'fuel_type': 'petrol',
 'id': '6ce1cd3a-eb83-5823-966f-6aa3e60d8e96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU39212',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 58846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2021}
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU39212%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Saving data for RU39212: {'auction_closing_time': 1774885381.0, 'created_time': 1774033736.628846, 'last_price_update_time': 1774723077.046474}
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU39212') HTTP/1.1" 204 0
2026-03-28 18:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Scrape type for ZS99681: 2
2026-03-28 18:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034a2824-1c4b-5cd7-9500-e8282218eed6 with identifier: ZS99681
2026-03-28 18:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034a2824-1c4b-5cd7-9500-e8282218eed6 with scrape type 2
2026-03-28 18:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 034a2824-1c4b-5cd7-9500-e8282218eed6 with scrape type 2
2026-03-28 18:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 034a2824-1c4b-5cd7-9500-e8282218eed6, identifier: ZS99681
2026-03-28 18:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 034a2824-1c4b-5cd7-9500-e8282218eed6 with identifier: ZS99681
2026-03-28 18:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 034a2824-1c4b-5cd7-9500-e8282218eed6 with identifier: ZS99681
2026-03-28 18:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 034a2824-1c4b-5cd7-9500-e8282218eed6 with identifier: ZS99681 to the API
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:51:15Z',
 'fuel_type': 'petrol',
 'id': '034a2824-1c4b-5cd7-9500-e8282218eed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS99681',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 90736,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-02',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2019}
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS99681%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Saving data for ZS99681: {'auction_closing_time': 1774885875.0, 'created_time': 1773467117.227302, 'last_price_update_time': 1774723077.604872}
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS99681') HTTP/1.1" 204 0
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Scrape type for EE75447: 1
2026-03-28 18:37:57 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-28 18:37:57 [auto1.de] INFO: Scrape type for RP15985: 2
2026-03-28 18:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with identifier: RP15985
2026-03-28 18:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with scrape type 2
2026-03-28 18:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with scrape type 2
2026-03-28 18:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2, identifier: RP15985
2026-03-28 18:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with identifier: RP15985
2026-03-28 18:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with identifier: RP15985
2026-03-28 18:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2 with identifier: RP15985 to the API
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:50Z',
 'fuel_type': 'diesel',
 'id': 'bfb6130f-de3d-5c91-b3f9-1aa7a7e6d1c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP15985',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 289580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2021}
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15985%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [auto1.de] INFO: Saving data for RP15985: {'auction_closing_time': 1774884350.0, 'created_time': 1774002726.462658, 'last_price_update_time': 1774723078.0681}
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP15985') HTTP/1.1" 204 0
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [auto1.de] INFO: Scrape type for SP96955: 1
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [auto1.de] INFO: Scrape type for GS31332: 2
2026-03-28 18:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8715f3d4-506f-55d0-bc31-c01447ec435a with identifier: GS31332
2026-03-28 18:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8715f3d4-506f-55d0-bc31-c01447ec435a with scrape type 2
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8715f3d4-506f-55d0-bc31-c01447ec435a with scrape type 2
2026-03-28 18:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8715f3d4-506f-55d0-bc31-c01447ec435a, identifier: GS31332
2026-03-28 18:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8715f3d4-506f-55d0-bc31-c01447ec435a with identifier: GS31332
2026-03-28 18:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8715f3d4-506f-55d0-bc31-c01447ec435a with identifier: GS31332
2026-03-28 18:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8715f3d4-506f-55d0-bc31-c01447ec435a with identifier: GS31332 to the API
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:11:15Z',
 'fuel_type': 'diesel',
 'id': '8715f3d4-506f-55d0-bc31-c01447ec435a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS31332',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 122200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-03',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS31332%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [auto1.de] INFO: Saving data for GS31332: {'auction_closing_time': 1774883475.0, 'created_time': 1774032704.244902, 'last_price_update_time': 1774723078.532771}
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS31332') HTTP/1.1" 204 0
2026-03-28 18:37:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: AM12815
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-28 18:37:58 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-28 18:37:58 [auto1.de] INFO: Scrape type for TH39634: 2
2026-03-28 18:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with identifier: TH39634
2026-03-28 18:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with scrape type 2
2026-03-28 18:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with scrape type 2
2026-03-28 18:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a0bf665-30ac-58fe-a002-cdc42e0b5153, identifier: TH39634
2026-03-28 18:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with identifier: TH39634
2026-03-28 18:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with identifier: TH39634
2026-03-28 18:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a0bf665-30ac-58fe-a002-cdc42e0b5153 with identifier: TH39634 to the API
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:21:38Z',
 'fuel_type': 'petrol',
 'id': '4a0bf665-30ac-58fe-a002-cdc42e0b5153',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH39634',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 96389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-11',
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2019}
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH39634%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Saving data for TH39634: {'auction_closing_time': 1774884098.0, 'created_time': 1774118822.399508, 'last_price_update_time': 1774723079.089148}
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH39634') HTTP/1.1" 204 0
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for MY94359: 1
2026-03-28 18:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS83554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NL79635> (referer: https://www.auto1.com/v1/car-details-view/NL79635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for ZS85048: 2
2026-03-28 18:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65cb925b-c3d9-5376-aab6-922093372766 with identifier: ZS85048
2026-03-28 18:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65cb925b-c3d9-5376-aab6-922093372766 with scrape type 2
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65cb925b-c3d9-5376-aab6-922093372766 with scrape type 2
2026-03-28 18:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65cb925b-c3d9-5376-aab6-922093372766, identifier: ZS85048
2026-03-28 18:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL66942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65cb925b-c3d9-5376-aab6-922093372766 with identifier: ZS85048
2026-03-28 18:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65cb925b-c3d9-5376-aab6-922093372766 with identifier: ZS85048
2026-03-28 18:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65cb925b-c3d9-5376-aab6-922093372766 with identifier: ZS85048 to the API
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:58:07Z',
 'fuel_type': 'petrol',
 'id': '65cb925b-c3d9-5376-aab6-922093372766',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS85048',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 112324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.0 TSI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2019}
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85048%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Saving data for ZS85048: {'auction_closing_time': 1774886287.0, 'created_time': 1774032517.900893, 'last_price_update_time': 1774723079.546496}
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS85048') HTTP/1.1" 204 0
2026-03-28 18:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:37:59 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [auto1.de] INFO: Scrape type for ZY92659: 1
2026-03-28 18:37:59 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 6003 | hits on page: 40
2026-03-28 18:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with identifier: NL79635
2026-03-28 18:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with scrape type 1
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1aed78a9-af99-5ac0-abb7-f00bc51f1de8
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_cbe2d25e32b21f615647350704482822.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_cbe2d25e32b21f615647350704482822.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_e915eed7442bf1af8604140d96bc5be6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_e915eed7442bf1af8604140d96bc5be6.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_7fa7c583730422059477b6f8715cf297.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_7fa7c583730422059477b6f8715cf297.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_437735fcbff8757e03bde7de147f364c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_437735fcbff8757e03bde7de147f364c.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_5290a50c8a75bad2e7255bb55f967675.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_5290a50c8a75bad2e7255bb55f967675.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_b3e146f5c10e8531c537f4bb487fb923.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_b3e146f5c10e8531c537f4bb487fb923.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_860f030baa6ec97f02e46541d8623eed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_860f030baa6ec97f02e46541d8623eed.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_dfafe0204a3899b25c5ab9fe18d3cbf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_dfafe0204a3899b25c5ab9fe18d3cbf4.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_c9070f034233f6c4066961f641f63fa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_c9070f034233f6c4066961f641f63fa3.jpg already downloaded
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252F05%252F3005b60a88cb5e917593f759f4915117%252Fpa%252FNL79635_c499604d4cd166029e36685c5cce93b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_c499604d4cd166029e36685c5cce93b6.jpg already downloaded
2026-03-28 18:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8, identifier: NL79635
2026-03-28 18:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with identifier: NL79635
2026-03-28 18:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with identifier: NL79635
2026-03-28 18:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1aed78a9-af99-5ac0-abb7-f00bc51f1de8 with identifier: NL79635 to the API
2026-03-28 18:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NL79635>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:34:23Z',
 'fuel_type': 'gas',
 'id': '1aed78a9-af99-5ac0-abb7-f00bc51f1de8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL79635',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 62899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_cbe2d25e32b21f615647350704482822.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_e915eed7442bf1af8604140d96bc5be6.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_7fa7c583730422059477b6f8715cf297.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_437735fcbff8757e03bde7de147f364c.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_5290a50c8a75bad2e7255bb55f967675.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_b3e146f5c10e8531c537f4bb487fb923.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_860f030baa6ec97f02e46541d8623eed.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_dfafe0204a3899b25c5ab9fe18d3cbf4.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_c9070f034233f6c4066961f641f63fa3.jpg',
                'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_c499604d4cd166029e36685c5cce93b6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69862,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_cbe2d25e32b21f615647350704482822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_e915eed7442bf1af8604140d96bc5be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_7fa7c583730422059477b6f8715cf297.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_437735fcbff8757e03bde7de147f364c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_5290a50c8a75bad2e7255bb55f967675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_b3e146f5c10e8531c537f4bb487fb923.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_860f030baa6ec97f02e46541d8623eed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_dfafe0204a3899b25c5ab9fe18d3cbf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_c9070f034233f6c4066961f641f63fa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1aed78a9-af99-5ac0-abb7-f00bc51f1de8/1aed78a9-af99-5ac0-abb7-f00bc51f1de8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/05/3005b60a88cb5e917593f759f4915117/pa/NL79635_c499604d4cd166029e36685c5cce93b6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe LPG Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2020}
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL79635%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Saving data for NL79635: {'created_time': 1774723080.202552, 'last_price_update_time': 1774723080.202564, 'auction_closing_time': 1774884863.0}
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NL79635') HTTP/1.1" 204 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for DK37949: 1
2026-03-28 18:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KR40526> (referer: https://www.auto1.com/v1/car-details-view/KR40526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UV09635/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for RF12873: 1
2026-03-28 18:38:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EE75447/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for XR35811: 1
2026-03-28 18:38:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for NC71734: 2
2026-03-28 18:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with identifier: NC71734
2026-03-28 18:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with scrape type 2
2026-03-28 18:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with scrape type 2
2026-03-28 18:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7, identifier: NC71734
2026-03-28 18:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with identifier: NC71734
2026-03-28 18:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with identifier: NC71734
2026-03-28 18:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67a9b5cb-7a46-5812-9c65-c8c62d78aad7 with identifier: NC71734 to the API
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:36:58Z',
 'fuel_type': 'diesel',
 'id': '67a9b5cb-7a46-5812-9c65-c8c62d78aad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC71734',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 201097,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-31',
 'seller_name': None,
 'title': 'Volkswagen Amarok 2.0 TDI Highline DoubleCab 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2014}
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC71734%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Saving data for NC71734: {'auction_closing_time': 1774885018.0, 'created_time': 1774350129.615007, 'last_price_update_time': 1774723080.73789}
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC71734') HTTP/1.1" 204 0
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-28 18:38:00 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-28 18:38:00 [auto1.de] INFO: Scrape type for JN07474: 2
2026-03-28 18:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with identifier: JN07474
2026-03-28 18:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with scrape type 2
2026-03-28 18:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with scrape type 2
2026-03-28 18:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26, identifier: JN07474
2026-03-28 18:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with identifier: JN07474
2026-03-28 18:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with identifier: JN07474
2026-03-28 18:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26 with identifier: JN07474 to the API
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:54:51Z',
 'fuel_type': 'diesel',
 'id': '1d9195f4-09f5-5ae9-aaf4-4f5af20d4a26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN07474',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 36801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-22',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi M L2',
 'transmission': 'automatic',
 'trim': 'M L2',
 'year': 2021}
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN07474%27 HTTP/1.1" 200 None
2026-03-28 18:38:01 [auto1.de] INFO: Saving data for JN07474: {'auction_closing_time': 1774886091.0, 'created_time': 1773340552.233394, 'last_price_update_time': 1774723081.286243}
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN07474') HTTP/1.1" 204 0
2026-03-28 18:38:01 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-28 18:38:01 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-28 18:38:01 [auto1.de] INFO: Scrape type for XZ21442: 1
2026-03-28 18:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP96955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e9501b-8055-5602-999b-2d9d6c9d3735 with identifier: KR40526
2026-03-28 18:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e9501b-8055-5602-999b-2d9d6c9d3735 with scrape type 1
2026-03-28 18:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b0e9501b-8055-5602-999b-2d9d6c9d3735
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_2bb60ad1e2e03a58968627238957fe02.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_2bb60ad1e2e03a58968627238957fe02.jpg not downloaded yet
2026-03-28 18:38:01 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-28 18:38:01 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-28 18:38:01 [auto1.de] INFO: Scrape type for YE73742: 2
2026-03-28 18:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3092703a-3bc1-5fa9-88c2-37c0c1727470 with identifier: YE73742
2026-03-28 18:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3092703a-3bc1-5fa9-88c2-37c0c1727470 with scrape type 2
2026-03-28 18:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3092703a-3bc1-5fa9-88c2-37c0c1727470 with scrape type 2
2026-03-28 18:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3092703a-3bc1-5fa9-88c2-37c0c1727470, identifier: YE73742
2026-03-28 18:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3092703a-3bc1-5fa9-88c2-37c0c1727470 with identifier: YE73742
2026-03-28 18:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3092703a-3bc1-5fa9-88c2-37c0c1727470 with identifier: YE73742
2026-03-28 18:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3092703a-3bc1-5fa9-88c2-37c0c1727470 with identifier: YE73742 to the API
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:13:31Z',
 'fuel_type': 'diesel',
 'id': '3092703a-3bc1-5fa9-88c2-37c0c1727470',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE73742',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 226331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 180 d Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE73742%27 HTTP/1.1" 200 None
2026-03-28 18:38:01 [auto1.de] INFO: Saving data for YE73742: {'auction_closing_time': 1774883611.0, 'created_time': 1774034558.005813, 'last_price_update_time': 1774723081.866022}
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YE73742') HTTP/1.1" 204 0
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_b6a36ad0d3ac5cea72747d3dade6b969.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_b6a36ad0d3ac5cea72747d3dade6b969.jpg not downloaded yet
2026-03-28 18:38:01 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-28 18:38:01 [auto1.de] INFO: Scrape type for CA87699: 2
2026-03-28 18:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db0dde72-9f6f-5c63-95f4-4778f607db0b with identifier: CA87699
2026-03-28 18:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db0dde72-9f6f-5c63-95f4-4778f607db0b with scrape type 2
2026-03-28 18:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db0dde72-9f6f-5c63-95f4-4778f607db0b with scrape type 2
2026-03-28 18:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db0dde72-9f6f-5c63-95f4-4778f607db0b, identifier: CA87699
2026-03-28 18:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db0dde72-9f6f-5c63-95f4-4778f607db0b with identifier: CA87699
2026-03-28 18:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db0dde72-9f6f-5c63-95f4-4778f607db0b with identifier: CA87699
2026-03-28 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db0dde72-9f6f-5c63-95f4-4778f607db0b with identifier: CA87699 to the API
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:45:24Z',
 'fuel_type': 'petrol',
 'id': 'db0dde72-9f6f-5c63-95f4-4778f607db0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA87699',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 152396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-02',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'automatic',
 'trim': 'Center-Line',
 'year': 2014}
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87699%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Saving data for CA87699: {'auction_closing_time': 1774885524.0, 'created_time': 1774002844.024808, 'last_price_update_time': 1774723082.369731}
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA87699') HTTP/1.1" 204 0
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_3c1f92427809095c918a6902f5e5bca4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_3c1f92427809095c918a6902f5e5bca4.jpg not downloaded yet
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for XU33519: 2
2026-03-28 18:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c197dd9f-3e80-5757-83dd-b2e39551ed79 with identifier: XU33519
2026-03-28 18:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c197dd9f-3e80-5757-83dd-b2e39551ed79 with scrape type 2
2026-03-28 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c197dd9f-3e80-5757-83dd-b2e39551ed79 with scrape type 2
2026-03-28 18:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c197dd9f-3e80-5757-83dd-b2e39551ed79, identifier: XU33519
2026-03-28 18:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c197dd9f-3e80-5757-83dd-b2e39551ed79 with identifier: XU33519
2026-03-28 18:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c197dd9f-3e80-5757-83dd-b2e39551ed79 with identifier: XU33519
2026-03-28 18:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c197dd9f-3e80-5757-83dd-b2e39551ed79 with identifier: XU33519 to the API
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:33Z',
 'fuel_type': 'petrol',
 'id': 'c197dd9f-3e80-5757-83dd-b2e39551ed79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU33519',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 131228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.4 TSI Design BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Design BlueMotion Tech',
 'year': 2015}
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU33519%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Saving data for XU33519: {'auction_closing_time': 1774883253.0, 'created_time': 1773306934.145586, 'last_price_update_time': 1774723082.876304}
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XU33519') HTTP/1.1" 204 0
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_bdbf324a56a46002752347b4f341a9ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_bdbf324a56a46002752347b4f341a9ae.jpg not downloaded yet
2026-03-28 18:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MY94359/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for NK26673: 1
2026-03-28 18:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_eb5f57a6404b1bce957747c3bf85244b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_eb5f57a6404b1bce957747c3bf85244b.jpg not downloaded yet
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-28 18:38:02 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-28 18:38:02 [auto1.de] INFO: Scrape type for NM76791: 2
2026-03-28 18:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08933ff9-a470-533b-965d-ca69f5319d78 with identifier: NM76791
2026-03-28 18:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08933ff9-a470-533b-965d-ca69f5319d78 with scrape type 2
2026-03-28 18:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08933ff9-a470-533b-965d-ca69f5319d78 with scrape type 2
2026-03-28 18:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08933ff9-a470-533b-965d-ca69f5319d78, identifier: NM76791
2026-03-28 18:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08933ff9-a470-533b-965d-ca69f5319d78 with identifier: NM76791
2026-03-28 18:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08933ff9-a470-533b-965d-ca69f5319d78 with identifier: NM76791
2026-03-28 18:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08933ff9-a470-533b-965d-ca69f5319d78 with identifier: NM76791 to the API
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:46:56Z',
 'fuel_type': 'diesel',
 'id': '08933ff9-a470-533b-965d-ca69f5319d78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM76791',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 141966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2014}
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM76791%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Saving data for NM76791: {'auction_closing_time': 1774885616.0, 'created_time': 1774032826.279349, 'last_price_update_time': 1774723083.374359}
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM76791') HTTP/1.1" 204 0
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: AU44008
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU44008%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for AU44008: 1
2026-03-28 18:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DK37949/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for UN89180: 1
2026-03-28 18:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZY92659/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS83554> (referer: https://www.auto1.com/v1/car-details-view/NS83554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF12873/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL66942> (referer: https://www.auto1.com/v1/car-details-view/PL66942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: WF14307
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF14307%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for WF14307: 1
2026-03-28 18:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for YH18669: 1
2026-03-28 18:38:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XR35811/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for KD63113: 1
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for FL46038: 1
2026-03-28 18:38:03 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-28 18:38:03 [auto1.de] INFO: Scrape type for NX82618: 2
2026-03-28 18:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8273e0e-7a50-5fa5-87b8-bc94313ba183 with identifier: NX82618
2026-03-28 18:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8273e0e-7a50-5fa5-87b8-bc94313ba183 with scrape type 2
2026-03-28 18:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8273e0e-7a50-5fa5-87b8-bc94313ba183 with scrape type 2
2026-03-28 18:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8273e0e-7a50-5fa5-87b8-bc94313ba183, identifier: NX82618
2026-03-28 18:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8273e0e-7a50-5fa5-87b8-bc94313ba183 with identifier: NX82618
2026-03-28 18:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8273e0e-7a50-5fa5-87b8-bc94313ba183 with identifier: NX82618
2026-03-28 18:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8273e0e-7a50-5fa5-87b8-bc94313ba183 with identifier: NX82618 to the API
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:04:14Z',
 'fuel_type': 'diesel',
 'id': 'a8273e0e-7a50-5fa5-87b8-bc94313ba183',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX82618',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 170050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-20',
 'seller_name': None,
 'title': 'BMW 5er 520d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2016}
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX82618%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [auto1.de] INFO: Saving data for NX82618: {'auction_closing_time': 1774883054.0, 'created_time': 1774033421.526101, 'last_price_update_time': 1774723084.088068}
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX82618') HTTP/1.1" 204 0
2026-03-28 18:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_3c1f92427809095c918a6902f5e5bca4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_2bb60ad1e2e03a58968627238957fe02.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_b6a36ad0d3ac5cea72747d3dade6b969.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:04 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [auto1.de] INFO: Scrape type for ZD28041: 2
2026-03-28 18:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b82387-3f39-57fc-b664-a1afef5d7ab4 with identifier: ZD28041
2026-03-28 18:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79b82387-3f39-57fc-b664-a1afef5d7ab4 with scrape type 2
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79b82387-3f39-57fc-b664-a1afef5d7ab4 with scrape type 2
2026-03-28 18:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79b82387-3f39-57fc-b664-a1afef5d7ab4, identifier: ZD28041
2026-03-28 18:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_bdbf324a56a46002752347b4f341a9ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79b82387-3f39-57fc-b664-a1afef5d7ab4 with identifier: ZD28041
2026-03-28 18:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79b82387-3f39-57fc-b664-a1afef5d7ab4 with identifier: ZD28041
2026-03-28 18:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79b82387-3f39-57fc-b664-a1afef5d7ab4 with identifier: ZD28041 to the API
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:23:37Z',
 'fuel_type': 'petrol',
 'id': '79b82387-3f39-57fc-b664-a1afef5d7ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD28041',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 111187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-18',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2013}
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD28041%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [auto1.de] INFO: Saving data for ZD28041: {'auction_closing_time': 1774884217.0, 'created_time': 1773467504.553741, 'last_price_update_time': 1774723084.593995}
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD28041') HTTP/1.1" 204 0
2026-03-28 18:38:04 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fd447f5-874c-5c58-8bb7-580aae0962a9 with identifier: NS83554
2026-03-28 18:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fd447f5-874c-5c58-8bb7-580aae0962a9 with scrape type 1
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7fd447f5-874c-5c58-8bb7-580aae0962a9
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fb5%252F28b546c95614bf1d1e42c2de61f1e09b%252Fpa%252FNS83554_0f270d418d5c3cb7e0a16f78231f2129.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_0f270d418d5c3cb7e0a16f78231f2129.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fb5%252F28b546c95614bf1d1e42c2de61f1e09b%252Fpa%252FNS83554_6727c163f285761315a94ad81acb130e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_6727c163f285761315a94ad81acb130e.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fb5%252F28b546c95614bf1d1e42c2de61f1e09b%252Fpa%252FNS83554_1dda9e8914a9f052ca60512fb48bc051.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_1dda9e8914a9f052ca60512fb48bc051.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fb5%252F28b546c95614bf1d1e42c2de61f1e09b%252Fpa%252FNS83554_1818b5ee631699176827a56da7efa936.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_1818b5ee631699176827a56da7efa936.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg28%252Fb5%252F28b546c95614bf1d1e42c2de61f1e09b%252Fpa%252FNS83554_df151ead2fd4ccb85ced2a902e03d835.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_df151ead2fd4ccb85ced2a902e03d835.jpg already downloaded
2026-03-28 18:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fd447f5-874c-5c58-8bb7-580aae0962a9, identifier: NS83554
2026-03-28 18:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 168581f5-722f-5c02-80f9-b7cbf94968e9 with identifier: PL66942
2026-03-28 18:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 168581f5-722f-5c02-80f9-b7cbf94968e9 with scrape type 1
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 168581f5-722f-5c02-80f9-b7cbf94968e9
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_54228f5212457b38412ae9ba2a101564.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_54228f5212457b38412ae9ba2a101564.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_71839c7dfb9fead10c1b4da05d6fbd37.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_71839c7dfb9fead10c1b4da05d6fbd37.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_5771f56744430833c0a49ac810dc6e45.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_5771f56744430833c0a49ac810dc6e45.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_2ba10ac3c01153fb19cfdd54b71f522a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_2ba10ac3c01153fb19cfdd54b71f522a.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_bed7b6bc31587fecc3ffc2ebbaa2ac1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_bed7b6bc31587fecc3ffc2ebbaa2ac1a.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_599acae7e05398b9211d974187d89d51.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_599acae7e05398b9211d974187d89d51.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_de10f0315704ea9dbd902cd9b7ccbbe8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_de10f0315704ea9dbd902cd9b7ccbbe8.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_69ac59bda855799ef9720193696f8fe9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_69ac59bda855799ef9720193696f8fe9.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_edff8c8a822d88632e974c644ce4c1a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_edff8c8a822d88632e974c644ce4c1a8.jpg already downloaded
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbd%252F34%252Fbd349b081008847bae8662da7ee2dde7%252Fpa%252FPL66942_437474278c966e056f432f84e65e4f06.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_437474278c966e056f432f84e65e4f06.jpg already downloaded
2026-03-28 18:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 168581f5-722f-5c02-80f9-b7cbf94968e9, identifier: PL66942
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for LK56613: 1
2026-03-28 18:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fd447f5-874c-5c58-8bb7-580aae0962a9 with identifier: NS83554
2026-03-28 18:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fd447f5-874c-5c58-8bb7-580aae0962a9 with identifier: NS83554
2026-03-28 18:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fd447f5-874c-5c58-8bb7-580aae0962a9 with identifier: NS83554 to the API
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NS83554>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:38Z',
 'fuel_type': 'petrol',
 'id': '7fd447f5-874c-5c58-8bb7-580aae0962a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS83554',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 283389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_0f270d418d5c3cb7e0a16f78231f2129.jpg',
                'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_6727c163f285761315a94ad81acb130e.jpg',
                'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_1dda9e8914a9f052ca60512fb48bc051.jpg',
                'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_1818b5ee631699176827a56da7efa936.jpg',
                'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_df151ead2fd4ccb85ced2a902e03d835.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd447f5-874c-5c58-8bb7-580aae0962a9/7fd447f5-874c-5c58-8bb7-580aae0962a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_0f270d418d5c3cb7e0a16f78231f2129.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd447f5-874c-5c58-8bb7-580aae0962a9/7fd447f5-874c-5c58-8bb7-580aae0962a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_6727c163f285761315a94ad81acb130e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd447f5-874c-5c58-8bb7-580aae0962a9/7fd447f5-874c-5c58-8bb7-580aae0962a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_1dda9e8914a9f052ca60512fb48bc051.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd447f5-874c-5c58-8bb7-580aae0962a9/7fd447f5-874c-5c58-8bb7-580aae0962a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70819,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_1818b5ee631699176827a56da7efa936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fd447f5-874c-5c58-8bb7-580aae0962a9/7fd447f5-874c-5c58-8bb7-580aae0962a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132505,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img28/b5/28b546c95614bf1d1e42c2de61f1e09b/pa/NS83554_df151ead2fd4ccb85ced2a902e03d835.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-10-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Honda Civic 1.8 VTEC Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2006}
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS83554%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Saving data for NS83554: {'created_time': 1774723085.428904, 'last_price_update_time': 1774723085.428916, 'auction_closing_time': 1774885898.0}
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS83554') HTTP/1.1" 204 0
2026-03-28 18:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 168581f5-722f-5c02-80f9-b7cbf94968e9 with identifier: PL66942
2026-03-28 18:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 168581f5-722f-5c02-80f9-b7cbf94968e9 with identifier: PL66942
2026-03-28 18:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 168581f5-722f-5c02-80f9-b7cbf94968e9 with identifier: PL66942 to the API
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PL66942>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:53:24Z',
 'fuel_type': 'petrol',
 'id': '168581f5-722f-5c02-80f9-b7cbf94968e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL66942',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 151635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_54228f5212457b38412ae9ba2a101564.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_71839c7dfb9fead10c1b4da05d6fbd37.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_5771f56744430833c0a49ac810dc6e45.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_2ba10ac3c01153fb19cfdd54b71f522a.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_bed7b6bc31587fecc3ffc2ebbaa2ac1a.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_599acae7e05398b9211d974187d89d51.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_de10f0315704ea9dbd902cd9b7ccbbe8.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_69ac59bda855799ef9720193696f8fe9.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_edff8c8a822d88632e974c644ce4c1a8.jpg',
                'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_437474278c966e056f432f84e65e4f06.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2663338,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_54228f5212457b38412ae9ba2a101564.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_71839c7dfb9fead10c1b4da05d6fbd37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70453,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_5771f56744430833c0a49ac810dc6e45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_2ba10ac3c01153fb19cfdd54b71f522a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_bed7b6bc31587fecc3ffc2ebbaa2ac1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_599acae7e05398b9211d974187d89d51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_de10f0315704ea9dbd902cd9b7ccbbe8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700675,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_69ac59bda855799ef9720193696f8fe9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_edff8c8a822d88632e974c644ce4c1a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168581f5-722f-5c02-80f9-b7cbf94968e9/168581f5-722f-5c02-80f9-b7cbf94968e9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbd/34/bd349b081008847bae8662da7ee2dde7/pa/PL66942_437474278c966e056f432f84e65e4f06.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL66942%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Saving data for PL66942: {'created_time': 1774723085.865003, 'last_price_update_time': 1774723085.865014, 'auction_closing_time': 1774886004.0}
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL66942') HTTP/1.1" 204 0
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-28 18:38:05 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-28 18:38:05 [auto1.de] INFO: Scrape type for GY83312: 2
2026-03-28 18:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1338f07-e6d1-549a-bfe3-13adfc570814 with identifier: GY83312
2026-03-28 18:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1338f07-e6d1-549a-bfe3-13adfc570814 with scrape type 2
2026-03-28 18:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1338f07-e6d1-549a-bfe3-13adfc570814 with scrape type 2
2026-03-28 18:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1338f07-e6d1-549a-bfe3-13adfc570814, identifier: GY83312
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4befe9d0>
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2121
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_3c1f92427809095c918a6902f5e5bca4.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_3c1f92427809095c918a6902f5e5bca4.jpg saved to cache
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b0e9501b-8055-5602-999b-2d9d6c9d3735
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdd8310>
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_2bb60ad1e2e03a58968627238957fe02.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_2bb60ad1e2e03a58968627238957fe02.jpg saved to cache
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b0e9501b-8055-5602-999b-2d9d6c9d3735
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd781d0>
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_b6a36ad0d3ac5cea72747d3dade6b969.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_b6a36ad0d3ac5cea72747d3dade6b969.jpg saved to cache
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b0e9501b-8055-5602-999b-2d9d6c9d3735
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for KV17598: 1
2026-03-28 18:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1338f07-e6d1-549a-bfe3-13adfc570814 with identifier: GY83312
2026-03-28 18:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1338f07-e6d1-549a-bfe3-13adfc570814 with identifier: GY83312
2026-03-28 18:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1338f07-e6d1-549a-bfe3-13adfc570814 with identifier: GY83312 to the API
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:13:11Z',
 'fuel_type': 'diesel',
 'id': 'a1338f07-e6d1-549a-bfe3-13adfc570814',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY83312',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 155938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-08',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 CRDi Intro Edition 4WD',
 'transmission': 'manual',
 'trim': 'Intro Edition 4WD',
 'year': 2016}
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83312%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Saving data for GY83312: {'auction_closing_time': 1774883591.0, 'created_time': 1773340640.73296, 'last_price_update_time': 1774723086.721724}
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY83312') HTTP/1.1" 204 0
2026-03-28 18:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EE75447> (referer: https://www.auto1.com/v1/car-details-view/EE75447/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for BG42804: 1
2026-03-28 18:38:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2fa0d0>
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_bdbf324a56a46002752347b4f341a9ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_bdbf324a56a46002752347b4f341a9ae.jpg saved to cache
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b0e9501b-8055-5602-999b-2d9d6c9d3735
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-28 18:38:06 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-28 18:38:06 [auto1.de] INFO: Scrape type for HX78633: 2
2026-03-28 18:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f800f70-39ce-526b-81f0-6f37b93eb330 with identifier: HX78633
2026-03-28 18:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f800f70-39ce-526b-81f0-6f37b93eb330 with scrape type 2
2026-03-28 18:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f800f70-39ce-526b-81f0-6f37b93eb330 with scrape type 2
2026-03-28 18:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f800f70-39ce-526b-81f0-6f37b93eb330, identifier: HX78633
2026-03-28 18:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_eb5f57a6404b1bce957747c3bf85244b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f800f70-39ce-526b-81f0-6f37b93eb330 with identifier: HX78633
2026-03-28 18:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f800f70-39ce-526b-81f0-6f37b93eb330 with identifier: HX78633
2026-03-28 18:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f800f70-39ce-526b-81f0-6f37b93eb330 with identifier: HX78633 to the API
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:07:59Z',
 'fuel_type': 'petrol',
 'id': '6f800f70-39ce-526b-81f0-6f37b93eb330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX78633',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 101454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-11',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX78633%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [auto1.de] INFO: Saving data for HX78633: {'auction_closing_time': 1774883279.0, 'created_time': 1774032876.147342, 'last_price_update_time': 1774723087.246504}
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX78633') HTTP/1.1" 204 0
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [auto1.de] INFO: Scrape type for HG43188: 1
2026-03-28 18:38:07 [scrapy.extensions.logstats] INFO: Crawled 192 pages (at 37 pages/min), scraped 466 items (at 81 items/min)
2026-03-28 18:38:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 164MiB
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [auto1.de] INFO: Scrape type for CW85183: 1
2026-03-28 18:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU44008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UN89180/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-28 18:38:07 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [auto1.de] INFO: Scrape type for KV68719: 1
2026-03-28 18:38:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44e36140-202a-52aa-bbc8-7287ce5f94bc with identifier: EE75447
2026-03-28 18:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e36140-202a-52aa-bbc8-7287ce5f94bc with scrape type 1
2026-03-28 18:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 44e36140-202a-52aa-bbc8-7287ce5f94bc
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_6fa6f0d3915069b8d5d8114e6ece71f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_6fa6f0d3915069b8d5d8114e6ece71f1.jpg not downloaded yet
2026-03-28 18:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d34d0>
2026-03-28 18:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F7c%252F087cba13dbecc6b493903e0c6befa643%252Fpa%252FKR40526_eb5f57a6404b1bce957747c3bf85244b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_eb5f57a6404b1bce957747c3bf85244b.jpg saved to cache
2026-03-28 18:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b0e9501b-8055-5602-999b-2d9d6c9d3735
2026-03-28 18:38:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b0e9501b-8055-5602-999b-2d9d6c9d3735, skipping ID generation
2026-03-28 18:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e9501b-8055-5602-999b-2d9d6c9d3735 with scrape type 1
2026-03-28 18:38:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b0e9501b-8055-5602-999b-2d9d6c9d3735 sending to next pipeline
2026-03-28 18:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0e9501b-8055-5602-999b-2d9d6c9d3735, identifier: KR40526
2026-03-28 18:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0e9501b-8055-5602-999b-2d9d6c9d3735 with identifier: KR40526
2026-03-28 18:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0e9501b-8055-5602-999b-2d9d6c9d3735 with identifier: KR40526
2026-03-28 18:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0e9501b-8055-5602-999b-2d9d6c9d3735 with identifier: KR40526 to the API
2026-03-28 18:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_eb5f57a6404b1bce957747c3bf85244b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:11:52Z',
 'fuel_type': 'diesel',
 'id': 'b0e9501b-8055-5602-999b-2d9d6c9d3735',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR40526',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 170054,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_2bb60ad1e2e03a58968627238957fe02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_b6a36ad0d3ac5cea72747d3dade6b969.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_3c1f92427809095c918a6902f5e5bca4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_bdbf324a56a46002752347b4f341a9ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b0e9501b-8055-5602-999b-2d9d6c9d3735/b0e9501b-8055-5602-999b-2d9d6c9d3735_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/7c/087cba13dbecc6b493903e0c6befa643/pa/KR40526_eb5f57a6404b1bce957747c3bf85244b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 DDiS Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2014}
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR40526%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [auto1.de] INFO: Saving data for KR40526: {'created_time': 1774723088.174897, 'last_price_update_time': 1774723088.174908, 'auction_closing_time': 1774883512.0}
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR40526') HTTP/1.1" 204 0
2026-03-28 18:38:08 [auto1.de] INFO: Found listing with ID: JP17422
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP17422%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [auto1.de] INFO: Scrape type for JP17422: 2
2026-03-28 18:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfa59ca2-9092-5d9b-ad4d-57251afabb46 with identifier: JP17422
2026-03-28 18:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfa59ca2-9092-5d9b-ad4d-57251afabb46 with scrape type 2
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bfa59ca2-9092-5d9b-ad4d-57251afabb46 with scrape type 2
2026-03-28 18:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bfa59ca2-9092-5d9b-ad4d-57251afabb46, identifier: JP17422
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_5f3d50dac99c35f54c5582ff8f9a911b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_5f3d50dac99c35f54c5582ff8f9a911b.jpg not downloaded yet
2026-03-28 18:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP96955> (referer: https://www.auto1.com/v1/car-details-view/SP96955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ21442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bfa59ca2-9092-5d9b-ad4d-57251afabb46 with identifier: JP17422
2026-03-28 18:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bfa59ca2-9092-5d9b-ad4d-57251afabb46 with identifier: JP17422
2026-03-28 18:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bfa59ca2-9092-5d9b-ad4d-57251afabb46 with identifier: JP17422 to the API
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:18:33Z',
 'fuel_type': 'petrol',
 'id': 'bfa59ca2-9092-5d9b-ad4d-57251afabb46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP17422',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 194921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-08',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.2 Tekna',
 'transmission': 'manual',
 'trim': 'Tekna',
 'year': 2018}
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP17422%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [auto1.de] INFO: Saving data for JP17422: {'auction_closing_time': 1774883913.0, 'created_time': 1773466955.848406, 'last_price_update_time': 1774723088.714466}
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP17422') HTTP/1.1" 204 0
2026-03-28 18:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK26673/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:08 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [auto1.de] INFO: Scrape type for GJ18953: 1
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_988af3c84ca4657766481d2cbf782e38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_988af3c84ca4657766481d2cbf782e38.jpg not downloaded yet
2026-03-28 18:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UV09635> (referer: https://www.auto1.com/v1/car-details-view/UV09635/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MY94359> (referer: https://www.auto1.com/v1/car-details-view/MY94359/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:08 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [auto1.de] INFO: Scrape type for GR83992: 1
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_c4643ede3837449d74aae5f297d7309a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_c4643ede3837449d74aae5f297d7309a.jpg not downloaded yet
2026-03-28 18:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3385d3d-4e81-5257-8856-61261fd75812 with identifier: SP96955
2026-03-28 18:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3385d3d-4e81-5257-8856-61261fd75812 with scrape type 1
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3385d3d-4e81-5257-8856-61261fd75812
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_0c38056d64b4efe631a0771d191b005f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_0c38056d64b4efe631a0771d191b005f.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_69aa91be945ad49eac3db787061fbafb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_69aa91be945ad49eac3db787061fbafb.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_2b790653618135e5c3bdc3817ca41b38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_2b790653618135e5c3bdc3817ca41b38.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_defed1abeee0093c74d89848bae3e8d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_defed1abeee0093c74d89848bae3e8d9.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_638d1b9e9baa7966fdd0e8cee2fed543.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_638d1b9e9baa7966fdd0e8cee2fed543.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_a761b48739d6064ee7bbe257d38d10d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_a761b48739d6064ee7bbe257d38d10d5.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_ae2e7f50f2bb1245bc9b1021efd1ea27.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_ae2e7f50f2bb1245bc9b1021efd1ea27.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_ec9cdb23936f0fbf9b2d0585e10110e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_ec9cdb23936f0fbf9b2d0585e10110e7.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_134e01c464ab6019bcb4908113dabc4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_134e01c464ab6019bcb4908113dabc4e.jpg already downloaded
2026-03-28 18:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252Fd1%252F62d1c64340cf3a05cc581c37336a4b85%252Fpa%252FSP96955_f738336b809fbacca666d6d88feddcf6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_f738336b809fbacca666d6d88feddcf6.jpg already downloaded
2026-03-28 18:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3385d3d-4e81-5257-8856-61261fd75812, identifier: SP96955
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-28 18:38:09 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Scrape type for BV89454: 2
2026-03-28 18:38:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b06400e5-91ce-5ce0-9773-19f871822648 with identifier: BV89454
2026-03-28 18:38:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b06400e5-91ce-5ce0-9773-19f871822648 with scrape type 2
2026-03-28 18:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b06400e5-91ce-5ce0-9773-19f871822648 with scrape type 2
2026-03-28 18:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b06400e5-91ce-5ce0-9773-19f871822648, identifier: BV89454
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_429485c33d415c34ebdbf17310aefa2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_429485c33d415c34ebdbf17310aefa2c.jpg not downloaded yet
2026-03-28 18:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3385d3d-4e81-5257-8856-61261fd75812 with identifier: SP96955
2026-03-28 18:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3385d3d-4e81-5257-8856-61261fd75812 with identifier: SP96955
2026-03-28 18:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3385d3d-4e81-5257-8856-61261fd75812 with identifier: SP96955 to the API
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SP96955>
{'auction_title': '',
 'c_o_2_emission_value': 201,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.5L',
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:14:16Z',
 'fuel_type': 'petrol',
 'id': 'c3385d3d-4e81-5257-8856-61261fd75812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP96955',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 167279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_0c38056d64b4efe631a0771d191b005f.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_69aa91be945ad49eac3db787061fbafb.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_2b790653618135e5c3bdc3817ca41b38.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_defed1abeee0093c74d89848bae3e8d9.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_638d1b9e9baa7966fdd0e8cee2fed543.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_a761b48739d6064ee7bbe257d38d10d5.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_ae2e7f50f2bb1245bc9b1021efd1ea27.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_ec9cdb23936f0fbf9b2d0585e10110e7.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_134e01c464ab6019bcb4908113dabc4e.jpg',
                'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_f738336b809fbacca666d6d88feddcf6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_0c38056d64b4efe631a0771d191b005f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103662,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_69aa91be945ad49eac3db787061fbafb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_2b790653618135e5c3bdc3817ca41b38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_defed1abeee0093c74d89848bae3e8d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_638d1b9e9baa7966fdd0e8cee2fed543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_a761b48739d6064ee7bbe257d38d10d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_ae2e7f50f2bb1245bc9b1021efd1ea27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_ec9cdb23936f0fbf9b2d0585e10110e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_134e01c464ab6019bcb4908113dabc4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3385d3d-4e81-5257-8856-61261fd75812/c3385d3d-4e81-5257-8856-61261fd75812_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/d1/62d1c64340cf3a05cc581c37336a4b85/pa/SP96955_f738336b809fbacca666d6d88feddcf6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96955%27 HTTP/1.1" 200 None
2026-03-28 18:38:09 [auto1.de] INFO: Saving data for SP96955: {'created_time': 1774723089.632257, 'last_price_update_time': 1774723089.632269, 'auction_closing_time': 1774883656.0}
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP96955') HTTP/1.1" 204 0
2026-03-28 18:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b06400e5-91ce-5ce0-9773-19f871822648 with identifier: BV89454
2026-03-28 18:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b06400e5-91ce-5ce0-9773-19f871822648 with identifier: BV89454
2026-03-28 18:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b06400e5-91ce-5ce0-9773-19f871822648 with identifier: BV89454 to the API
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:36:58Z',
 'fuel_type': 'petrol',
 'id': 'b06400e5-91ce-5ce0-9773-19f871822648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV89454',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 189699,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-08',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Tonic',
 'transmission': 'manual',
 'trim': 'Tonic',
 'year': 2009}
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV89454%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Saving data for BV89454: {'auction_closing_time': 1774885018.0, 'created_time': 1774349516.343567, 'last_price_update_time': 1774723090.076013}
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV89454') HTTP/1.1" 204 0
2026-03-28 18:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_6fa6f0d3915069b8d5d8114e6ece71f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_5f3d50dac99c35f54c5582ff8f9a911b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for MX21840: 1
2026-03-28 18:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5535f39-5b58-5ca5-b54d-1085d87996f6 with identifier: UV09635
2026-03-28 18:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5535f39-5b58-5ca5-b54d-1085d87996f6 with scrape type 1
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b5535f39-5b58-5ca5-b54d-1085d87996f6
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_9ffa42eeed9b9f474df3b3114d0ad503.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_9ffa42eeed9b9f474df3b3114d0ad503.jpg not downloaded yet
2026-03-28 18:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cd6a9bb-9bc7-5717-8c44-5651965042ea with identifier: MY94359
2026-03-28 18:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea with scrape type 1
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_0d03f317845d03affcf400e33afc5570.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_0d03f317845d03affcf400e33afc5570.jpg not downloaded yet
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for DR45963: 1
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_1e67a18cbb9643553776557d45d78a75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_1e67a18cbb9643553776557d45d78a75.jpg not downloaded yet
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_b86301c6d26c9e7edc1305e6b3f5d82e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_b86301c6d26c9e7edc1305e6b3f5d82e.jpg not downloaded yet
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for RW68722: 1
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_6b58b927127ad6122c1049e88bada138.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_6b58b927127ad6122c1049e88bada138.jpg not downloaded yet
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_18f4753b4623b80f20e6af8ef6960a1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_18f4753b4623b80f20e6af8ef6960a1a.jpg not downloaded yet
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for EC85375: 2
2026-03-28 18:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d00fc2ae-8ac7-5bd9-be44-60353de5b84c with identifier: EC85375
2026-03-28 18:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d00fc2ae-8ac7-5bd9-be44-60353de5b84c with scrape type 2
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d00fc2ae-8ac7-5bd9-be44-60353de5b84c with scrape type 2
2026-03-28 18:38:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d00fc2ae-8ac7-5bd9-be44-60353de5b84c, identifier: EC85375
2026-03-28 18:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d00fc2ae-8ac7-5bd9-be44-60353de5b84c with identifier: EC85375
2026-03-28 18:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d00fc2ae-8ac7-5bd9-be44-60353de5b84c with identifier: EC85375
2026-03-28 18:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d00fc2ae-8ac7-5bd9-be44-60353de5b84c with identifier: EC85375 to the API
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-30T15:17:44Z',
 'fuel_type': 'petrol',
 'id': 'd00fc2ae-8ac7-5bd9-be44-60353de5b84c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC85375',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 157956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-30',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Independence',
 'transmission': 'manual',
 'trim': 'Independence',
 'year': 2010}
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC85375%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Saving data for EC85375: {'auction_closing_time': 1774883864.0, 'created_time': 1774032323.093602, 'last_price_update_time': 1774723090.754884}
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC85375') HTTP/1.1" 204 0
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_853c31d081dbcf139a8e8ec64e02009b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_853c31d081dbcf139a8e8ec64e02009b.jpg not downloaded yet
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_f14de84b55a0b568918c255967c6be61.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_f14de84b55a0b568918c255967c6be61.jpg not downloaded yet
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for JX30830: 1
2026-03-28 18:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be73390>
2026-03-28 18:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_6fa6f0d3915069b8d5d8114e6ece71f1.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_6fa6f0d3915069b8d5d8114e6ece71f1.jpg saved to cache
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 44e36140-202a-52aa-bbc8-7287ce5f94bc
2026-03-28 18:38:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc30d50>
2026-03-28 18:38:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_5f3d50dac99c35f54c5582ff8f9a911b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_5f3d50dac99c35f54c5582ff8f9a911b.jpg saved to cache
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 44e36140-202a-52aa-bbc8-7287ce5f94bc
2026-03-28 18:38:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_429485c33d415c34ebdbf17310aefa2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_4bf40482805158e3a246c01cdd9443d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_4bf40482805158e3a246c01cdd9443d5.jpg not downloaded yet
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_eb4f9a1b9836c1b14b448499c3af9f66.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_eb4f9a1b9836c1b14b448499c3af9f66.jpg not downloaded yet
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-28 18:38:10 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-28 18:38:10 [auto1.de] INFO: Scrape type for VX97978: 2
2026-03-28 18:38:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f485d5-d118-56c5-bd8b-9d05d392db74 with identifier: VX97978
2026-03-28 18:38:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f485d5-d118-56c5-bd8b-9d05d392db74 with scrape type 2
2026-03-28 18:38:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6f485d5-d118-56c5-bd8b-9d05d392db74 with scrape type 2
2026-03-28 18:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6f485d5-d118-56c5-bd8b-9d05d392db74, identifier: VX97978
2026-03-28 18:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD63113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WF14307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6f485d5-d118-56c5-bd8b-9d05d392db74 with identifier: VX97978
2026-03-28 18:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6f485d5-d118-56c5-bd8b-9d05d392db74 with identifier: VX97978
2026-03-28 18:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6f485d5-d118-56c5-bd8b-9d05d392db74 with identifier: VX97978 to the API
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:32:16Z',
 'fuel_type': 'petrol',
 'id': 'd6f485d5-d118-56c5-bd8b-9d05d392db74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX97978',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 135389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-30',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2007}
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX97978%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Saving data for VX97978: {'auction_closing_time': 1774884736.0, 'created_time': 1773467153.96284, 'last_price_update_time': 1774723091.38565}
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX97978') HTTP/1.1" 204 0
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_a5b20db8020a8a59900f4ce67e552c4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_a5b20db8020a8a59900f4ce67e552c4f.jpg not downloaded yet
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_60e3b88ae7187aed62502699f82852d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_60e3b88ae7187aed62502699f82852d7.jpg not downloaded yet
2026-03-28 18:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Scrape type for ED69500: 2
2026-03-28 18:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cf4e678-380e-5396-9dc9-4a4a967d1161 with identifier: ED69500
2026-03-28 18:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cf4e678-380e-5396-9dc9-4a4a967d1161 with scrape type 2
2026-03-28 18:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cf4e678-380e-5396-9dc9-4a4a967d1161 with scrape type 2
2026-03-28 18:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cf4e678-380e-5396-9dc9-4a4a967d1161, identifier: ED69500
2026-03-28 18:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cf4e678-380e-5396-9dc9-4a4a967d1161 with identifier: ED69500
2026-03-28 18:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cf4e678-380e-5396-9dc9-4a4a967d1161 with identifier: ED69500
2026-03-28 18:38:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cf4e678-380e-5396-9dc9-4a4a967d1161 with identifier: ED69500 to the API
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:35:59Z',
 'fuel_type': 'petrol',
 'id': '3cf4e678-380e-5396-9dc9-4a4a967d1161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED69500',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 78683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED69500%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [auto1.de] INFO: Saving data for ED69500: {'auction_closing_time': 1774884959.0, 'created_time': 1773400177.767628, 'last_price_update_time': 1774723091.945089}
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED69500') HTTP/1.1" 204 0
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_2371f9e94ed2401f94faad6405cda425.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_2371f9e94ed2401f94faad6405cda425.jpg not downloaded yet
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-28 18:38:11 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-28 18:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for AN99140: 2
2026-03-28 18:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0f532b4-b525-51ff-a333-0a0579dcf330 with identifier: AN99140
2026-03-28 18:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0f532b4-b525-51ff-a333-0a0579dcf330 with scrape type 2
2026-03-28 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0f532b4-b525-51ff-a333-0a0579dcf330 with scrape type 2
2026-03-28 18:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0f532b4-b525-51ff-a333-0a0579dcf330, identifier: AN99140
2026-03-28 18:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH18669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DK37949> (referer: https://www.auto1.com/v1/car-details-view/DK37949/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF12873> (referer: https://www.auto1.com/v1/car-details-view/RF12873/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LK56613/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb95710>
2026-03-28 18:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_429485c33d415c34ebdbf17310aefa2c.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_429485c33d415c34ebdbf17310aefa2c.jpg saved to cache
2026-03-28 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 44e36140-202a-52aa-bbc8-7287ce5f94bc
2026-03-28 18:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_4bf40482805158e3a246c01cdd9443d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0f532b4-b525-51ff-a333-0a0579dcf330 with identifier: AN99140
2026-03-28 18:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0f532b4-b525-51ff-a333-0a0579dcf330 with identifier: AN99140
2026-03-28 18:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0f532b4-b525-51ff-a333-0a0579dcf330 with identifier: AN99140 to the API
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:04:31Z',
 'fuel_type': 'petrol',
 'id': 'd0f532b4-b525-51ff-a333-0a0579dcf330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN99140',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 46494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-20',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN99140%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Saving data for AN99140: {'auction_closing_time': 1774883071.0, 'created_time': 1774002402.66474, 'last_price_update_time': 1774723092.512906}
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN99140') HTTP/1.1" 204 0
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_66e21341ad6ffda07c2d2e3d8b3b9c70.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_66e21341ad6ffda07c2d2e3d8b3b9c70.jpg not downloaded yet
2026-03-28 18:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL46038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for FD40697: 1
2026-03-28 18:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_08e3810224322622c5344b9329c9fb90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_08e3810224322622c5344b9329c9fb90.jpg not downloaded yet
2026-03-28 18:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XR35811> (referer: https://www.auto1.com/v1/car-details-view/XR35811/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:12 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-28 18:38:12 [auto1.de] INFO: Scrape type for UK28270: 2
2026-03-28 18:38:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef21c165-76d9-5102-9f85-0a741d1a19f0 with identifier: UK28270
2026-03-28 18:38:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef21c165-76d9-5102-9f85-0a741d1a19f0 with scrape type 2
2026-03-28 18:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef21c165-76d9-5102-9f85-0a741d1a19f0 with scrape type 2
2026-03-28 18:38:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef21c165-76d9-5102-9f85-0a741d1a19f0, identifier: UK28270
2026-03-28 18:38:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef21c165-76d9-5102-9f85-0a741d1a19f0 with identifier: UK28270
2026-03-28 18:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef21c165-76d9-5102-9f85-0a741d1a19f0 with identifier: UK28270
2026-03-28 18:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef21c165-76d9-5102-9f85-0a741d1a19f0 with identifier: UK28270 to the API
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:44:16Z',
 'fuel_type': 'hybrid',
 'id': 'ef21c165-76d9-5102-9f85-0a741d1a19f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK28270',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 116459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 Plug-in Hybrid Style iV',
 'transmission': 'automatic',
 'trim': 'Style iV',
 'year': 2020}
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28270%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [auto1.de] INFO: Saving data for UK28270: {'auction_closing_time': 1774885456.0, 'created_time': 1774349034.900698, 'last_price_update_time': 1774723093.060542}
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK28270') HTTP/1.1" 204 0
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_5897f5c8a1c65f9445eb19bf3dcac8f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_5897f5c8a1c65f9445eb19bf3dcac8f0.jpg not downloaded yet
2026-03-28 18:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77ff899a-fdf6-5197-8387-2dc3b38f5959 with identifier: DK37949
2026-03-28 18:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77ff899a-fdf6-5197-8387-2dc3b38f5959 with scrape type 1
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77ff899a-fdf6-5197-8387-2dc3b38f5959
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_78f6d465f2a28724d25b4e4f5735162c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_78f6d465f2a28724d25b4e4f5735162c.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_a81b61d735ce77bfdf03be71e9230dfe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_a81b61d735ce77bfdf03be71e9230dfe.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_803fa3bef8e82edff45b373da7852d76.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_803fa3bef8e82edff45b373da7852d76.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_a3ebb3a623d8b418cbbe519eb7803aff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_a3ebb3a623d8b418cbbe519eb7803aff.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_9fc4cb5d9063e09f23c7a3db6c08e778.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_9fc4cb5d9063e09f23c7a3db6c08e778.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_3b37d2fb3b36e7565f8640e47497d4b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_3b37d2fb3b36e7565f8640e47497d4b6.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_556c2cec3ff69cddcf79d4bb7f39e378.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_556c2cec3ff69cddcf79d4bb7f39e378.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_2e6d56299dce9d30f0160660f87df766.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_2e6d56299dce9d30f0160660f87df766.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_22b2226b5e7e41d89a24f91e83250c73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_22b2226b5e7e41d89a24f91e83250c73.jpg already downloaded
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F19%252F88192722c23518812c008905a9eae79e%252Fpa%252FDK37949_347bbcdab74094586b4f9a8be11dd505.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_347bbcdab74094586b4f9a8be11dd505.jpg already downloaded
2026-03-28 18:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77ff899a-fdf6-5197-8387-2dc3b38f5959, identifier: DK37949
2026-03-28 18:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2de83903-3e01-55d4-ae21-eb41d0d128cb with identifier: RF12873
2026-03-28 18:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de83903-3e01-55d4-ae21-eb41d0d128cb with scrape type 1
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_5919b78a4c6b0f706a3396ebc1f267f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_5919b78a4c6b0f706a3396ebc1f267f6.jpg not downloaded yet
2026-03-28 18:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb1710>
2026-03-28 18:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_4bf40482805158e3a246c01cdd9443d5.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_4bf40482805158e3a246c01cdd9443d5.jpg saved to cache
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5535f39-5b58-5ca5-b54d-1085d87996f6
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [auto1.de] INFO: Scrape type for UG29438: 1
2026-03-28 18:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77ff899a-fdf6-5197-8387-2dc3b38f5959 with identifier: DK37949
2026-03-28 18:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77ff899a-fdf6-5197-8387-2dc3b38f5959 with identifier: DK37949
2026-03-28 18:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77ff899a-fdf6-5197-8387-2dc3b38f5959 with identifier: DK37949 to the API
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DK37949>
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:10:48Z',
 'fuel_type': 'diesel',
 'id': '77ff899a-fdf6-5197-8387-2dc3b38f5959',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK37949',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 114960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_78f6d465f2a28724d25b4e4f5735162c.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_a81b61d735ce77bfdf03be71e9230dfe.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_803fa3bef8e82edff45b373da7852d76.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_a3ebb3a623d8b418cbbe519eb7803aff.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_9fc4cb5d9063e09f23c7a3db6c08e778.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_3b37d2fb3b36e7565f8640e47497d4b6.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_556c2cec3ff69cddcf79d4bb7f39e378.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_2e6d56299dce9d30f0160660f87df766.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_22b2226b5e7e41d89a24f91e83250c73.jpg',
                'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_347bbcdab74094586b4f9a8be11dd505.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_78f6d465f2a28724d25b4e4f5735162c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_a81b61d735ce77bfdf03be71e9230dfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_803fa3bef8e82edff45b373da7852d76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_a3ebb3a623d8b418cbbe519eb7803aff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_9fc4cb5d9063e09f23c7a3db6c08e778.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_3b37d2fb3b36e7565f8640e47497d4b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_556c2cec3ff69cddcf79d4bb7f39e378.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_2e6d56299dce9d30f0160660f87df766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_22b2226b5e7e41d89a24f91e83250c73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77ff899a-fdf6-5197-8387-2dc3b38f5959/77ff899a-fdf6-5197-8387-2dc3b38f5959_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/19/88192722c23518812c008905a9eae79e/pa/DK37949_347bbcdab74094586b4f9a8be11dd505.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-25',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang 4Matic BlueTEC Avantgarde '
          'Edition',
 'transmission': 'automatic',
 'trim': 'lang 4Matic BlueTEC Avantgarde Edition',
 'year': 2018}
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK37949%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [auto1.de] INFO: Saving data for DK37949: {'created_time': 1774723093.803787, 'last_price_update_time': 1774723093.803797, 'auction_closing_time': 1774883448.0}
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK37949') HTTP/1.1" 204 0
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_e91a9bab1dc1cef203fa64b1fd0b1505.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_e91a9bab1dc1cef203fa64b1fd0b1505.jpg not downloaded yet
2026-03-28 18:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_f14de84b55a0b568918c255967c6be61.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_a5b20db8020a8a59900f4ce67e552c4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [auto1.de] INFO: Scrape type for NY30954: 1
2026-03-28 18:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1689c499-9578-51a4-b130-15ce53373f03 with identifier: XR35811
2026-03-28 18:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1689c499-9578-51a4-b130-15ce53373f03 with scrape type 1
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_ba6ab8d71b87fc05b8e7a2e64c925172.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ba6ab8d71b87fc05b8e7a2e64c925172.jpg not downloaded yet
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_9580e8209ae7d0a070f333229bc75bc7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_9580e8209ae7d0a070f333229bc75bc7.jpg not downloaded yet
2026-03-28 18:38:13 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-28 18:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [auto1.de] INFO: Scrape type for HH84481: 1
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_a3bcade53153a58f253e19ed20f54269.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_a3bcade53153a58f253e19ed20f54269.jpg not downloaded yet
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_f9abc06dbbb3a922c18c12ff50851ea9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_f9abc06dbbb3a922c18c12ff50851ea9.jpg not downloaded yet
2026-03-28 18:38:14 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [auto1.de] INFO: Scrape type for NZ79152: 1
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_eba9fea970e174b8e9cd1d2304607690.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_eba9fea970e174b8e9cd1d2304607690.jpg not downloaded yet
2026-03-28 18:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb3d4d0>
2026-03-28 18:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_f14de84b55a0b568918c255967c6be61.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_f14de84b55a0b568918c255967c6be61.jpg saved to cache
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2ee810>
2026-03-28 18:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_a5b20db8020a8a59900f4ce67e552c4f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_a5b20db8020a8a59900f4ce67e552c4f.jpg saved to cache
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5535f39-5b58-5ca5-b54d-1085d87996f6
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_13896d92cbe9d44af08e25be4c0ef062.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_13896d92cbe9d44af08e25be4c0ef062.jpg not downloaded yet
2026-03-28 18:38:14 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-28 18:38:14 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [auto1.de] INFO: Scrape type for KA54911: 1
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_ef9932c527f9390b8a32682f1b0ef20d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ef9932c527f9390b8a32682f1b0ef20d.jpg not downloaded yet
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_434a46270960bcbf9005b1c995c18b60.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_434a46270960bcbf9005b1c995c18b60.jpg not downloaded yet
2026-03-28 18:38:14 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [auto1.de] INFO: Scrape type for TV53465: 1
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_32d546c369c5d55f2c3d4d26e30228e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_32d546c369c5d55f2c3d4d26e30228e3.jpg not downloaded yet
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_18f6dcefaadea460c010a4adf358e2d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_18f6dcefaadea460c010a4adf358e2d4.jpg not downloaded yet
2026-03-28 18:38:14 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [auto1.de] INFO: Scrape type for UP69379: 2
2026-03-28 18:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fa03297-478c-5b20-a92c-90c36e413862 with identifier: UP69379
2026-03-28 18:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fa03297-478c-5b20-a92c-90c36e413862 with scrape type 2
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fa03297-478c-5b20-a92c-90c36e413862 with scrape type 2
2026-03-28 18:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fa03297-478c-5b20-a92c-90c36e413862, identifier: UP69379
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_f30bbc77dd478f42ac3712e74fc73883.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_f30bbc77dd478f42ac3712e74fc73883.jpg not downloaded yet
2026-03-28 18:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fa03297-478c-5b20-a92c-90c36e413862 with identifier: UP69379
2026-03-28 18:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fa03297-478c-5b20-a92c-90c36e413862 with identifier: UP69379
2026-03-28 18:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fa03297-478c-5b20-a92c-90c36e413862 with identifier: UP69379 to the API
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:10:03Z',
 'fuel_type': 'petrol',
 'id': '0fa03297-478c-5b20-a92c-90c36e413862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP69379',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 177767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-31',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2016}
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP69379%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [auto1.de] INFO: Saving data for UP69379: {'auction_closing_time': 1774883403.0, 'created_time': 1774379562.115091, 'last_price_update_time': 1774723094.739764}
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP69379') HTTP/1.1" 204 0
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_8ea48cffdd5900da8b14687ed4dcc4cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_8ea48cffdd5900da8b14687ed4dcc4cd.jpg not downloaded yet
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_abbe8dcae4ccc85851642fa8af13d4c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_abbe8dcae4ccc85851642fa8af13d4c9.jpg not downloaded yet
2026-03-28 18:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_08e3810224322622c5344b9329c9fb90.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_8636ffc92059921abbe123b94dd38915.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_8636ffc92059921abbe123b94dd38915.jpg not downloaded yet
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_a4b7c5b2d8c3b6a26f2645c1f2509d04.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_a4b7c5b2d8c3b6a26f2645c1f2509d04.jpg not downloaded yet
2026-03-28 18:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG42804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW85183/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV17598/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ21442> (referer: https://www.auto1.com/v1/car-details-view/XZ21442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UN89180> (referer: https://www.auto1.com/v1/car-details-view/UN89180/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HG43188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_fad4599a8ff0d901521994c47b2fd588.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_fad4599a8ff0d901521994c47b2fd588.jpg not downloaded yet
2026-03-28 18:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_659f83c8b677b8778a7434e254238088.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_659f83c8b677b8778a7434e254238088.jpg not downloaded yet
2026-03-28 18:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_3265991c1e91b107f92332e64f84fc6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_3265991c1e91b107f92332e64f84fc6f.jpg not downloaded yet
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JX30830/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c7790>
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_08e3810224322622c5344b9329c9fb90.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_08e3810224322622c5344b9329c9fb90.jpg saved to cache
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93d26785-fd90-52b9-85c8-3213dce4b022 with identifier: XZ21442
2026-03-28 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d26785-fd90-52b9-85c8-3213dce4b022 with scrape type 1
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_a4051500e5742750bc6a7ca356720ad1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_a4051500e5742750bc6a7ca356720ad1.jpg not downloaded yet
2026-03-28 18:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fb06940-f82d-57ef-b024-a09fe65c2cbb with identifier: UN89180
2026-03-28 18:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb with scrape type 1
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_3193a08662b5e965a05f136e6d1683ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_3193a08662b5e965a05f136e6d1683ed.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_aea620f4e1b05d3e991341ea23b2a927.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_aea620f4e1b05d3e991341ea23b2a927.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_fa91736aa5fc43186213fc0cede95877.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_fa91736aa5fc43186213fc0cede95877.jpg not downloaded yet
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_abbe8dcae4ccc85851642fa8af13d4c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_8636ffc92059921abbe123b94dd38915.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_8ea48cffdd5900da8b14687ed4dcc4cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_e6df4443bdacfdec403e56f39206c54e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_e6df4443bdacfdec403e56f39206c54e.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_74e64d0c609db7383e0efd4b9c063af0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_74e64d0c609db7383e0efd4b9c063af0.jpg not downloaded yet
2026-03-28 18:38:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_3eb100908445b31b50808e90acc6b895.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_3eb100908445b31b50808e90acc6b895.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_22d51c5f7246afa1777bc75206fb8ec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_22d51c5f7246afa1777bc75206fb8ec8.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_752a60e969ac7cd524b599c9cf7cb7b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_752a60e969ac7cd524b599c9cf7cb7b5.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_6c3305de3ed13daaa1dca4246820879f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_6c3305de3ed13daaa1dca4246820879f.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_4d4713f2804b364fa5ea2a4a49133751.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_4d4713f2804b364fa5ea2a4a49133751.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_d488663c489dcc4a0dbd6ea592966c57.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_d488663c489dcc4a0dbd6ea592966c57.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_b6e5c05b44566e00af6e56fbcd17eb51.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_b6e5c05b44566e00af6e56fbcd17eb51.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_748b5a2259567b0d28de13bed8dfab1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_748b5a2259567b0d28de13bed8dfab1c.jpg not downloaded yet
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2fb810>
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_abbe8dcae4ccc85851642fa8af13d4c9.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_abbe8dcae4ccc85851642fa8af13d4c9.jpg saved to cache
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd6b050>
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_8636ffc92059921abbe123b94dd38915.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_8636ffc92059921abbe123b94dd38915.jpg saved to cache
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd6a150>
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_8ea48cffdd5900da8b14687ed4dcc4cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_8ea48cffdd5900da8b14687ed4dcc4cd.jpg saved to cache
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_eb4f9a1b9836c1b14b448499c3af9f66.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_d24de2f66d18e87ceefbca3cdbd0e02d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_d24de2f66d18e87ceefbca3cdbd0e02d.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_df7fc6d42f371728ed4267deb83d0af6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_df7fc6d42f371728ed4267deb83d0af6.jpg not downloaded yet
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_2371f9e94ed2401f94faad6405cda425.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_32d546c369c5d55f2c3d4d26e30228e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_fa91736aa5fc43186213fc0cede95877.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_3265991c1e91b107f92332e64f84fc6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_1684f72608a90767e00cbc11a7b9924f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_1684f72608a90767e00cbc11a7b9924f.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_00409da09f6c480c67263334aa82473f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_00409da09f6c480c67263334aa82473f.jpg not downloaded yet
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_60e3b88ae7187aed62502699f82852d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV68719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_2f3e676cc78a2b26f34aef6291e6b709.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_2f3e676cc78a2b26f34aef6291e6b709.jpg not downloaded yet
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_082f0ee612ffc390f05f8e350a2ed987.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_082f0ee612ffc390f05f8e350a2ed987.jpg not downloaded yet
2026-03-28 18:38:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ff5b50>
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_eb4f9a1b9836c1b14b448499c3af9f66.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_eb4f9a1b9836c1b14b448499c3af9f66.jpg saved to cache
2026-03-28 18:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc9db10>
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_2371f9e94ed2401f94faad6405cda425.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_2371f9e94ed2401f94faad6405cda425.jpg saved to cache
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b218290>
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_32d546c369c5d55f2c3d4d26e30228e3.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_32d546c369c5d55f2c3d4d26e30228e3.jpg saved to cache
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbabf50>
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_fa91736aa5fc43186213fc0cede95877.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_fa91736aa5fc43186213fc0cede95877.jpg saved to cache
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b21a4d0>
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_3265991c1e91b107f92332e64f84fc6f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_3265991c1e91b107f92332e64f84fc6f.jpg saved to cache
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb3c050>
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_60e3b88ae7187aed62502699f82852d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_60e3b88ae7187aed62502699f82852d7.jpg saved to cache
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV53465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG29438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WF14307> (referer: https://www.auto1.com/v1/car-details-view/WF14307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD63113> (referer: https://www.auto1.com/v1/car-details-view/KD63113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_18f6dcefaadea460c010a4adf358e2d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_f30bbc77dd478f42ac3712e74fc73883.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HG43188> (referer: https://www.auto1.com/v1/car-details-view/HG43188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2a6e24-e275-5c8f-977e-046dea6e023d with identifier: WF14307
2026-03-28 18:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2a6e24-e275-5c8f-977e-046dea6e023d with scrape type 1
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_a171f3a6e80721dc626f3880fa8f3550.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_a171f3a6e80721dc626f3880fa8f3550.jpg not downloaded yet
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_e3e9412359b2823e5201bd4f577239ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_e3e9412359b2823e5201bd4f577239ec.jpg not downloaded yet
2026-03-28 18:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91fbfd3b-6a4b-5490-8430-5cf09c235677 with identifier: KD63113
2026-03-28 18:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91fbfd3b-6a4b-5490-8430-5cf09c235677 with scrape type 1
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_1dba81fd6527e6c68ac463ea79671c01.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_1dba81fd6527e6c68ac463ea79671c01.jpg not downloaded yet
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_67d91447dcbf4b0753dfae93e842b920.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_67d91447dcbf4b0753dfae93e842b920.jpg not downloaded yet
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_7ce9a22ca09420250d03f9382f34c415.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_7ce9a22ca09420250d03f9382f34c415.jpg not downloaded yet
2026-03-28 18:38:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdab990>
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_18f6dcefaadea460c010a4adf358e2d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_18f6dcefaadea460c010a4adf358e2d4.jpg saved to cache
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc97710>
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_f30bbc77dd478f42ac3712e74fc73883.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_f30bbc77dd478f42ac3712e74fc73883.jpg saved to cache
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_00409da09f6c480c67263334aa82473f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_df7fc6d42f371728ed4267deb83d0af6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_5b5101ca3b34bd8c1bb3de85d8020a80.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_5b5101ca3b34bd8c1bb3de85d8020a80.jpg not downloaded yet
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_6a65b9f856eebfdede6924f972ed319a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_6a65b9f856eebfdede6924f972ed319a.jpg not downloaded yet
2026-03-28 18:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JX30830> (referer: https://www.auto1.com/v1/car-details-view/JX30830/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-03-28 18:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45dec50c-ac33-5893-96d7-8a020af7a3b5 with scrape type 1
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 45dec50c-ac33-5893-96d7-8a020af7a3b5
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_cf0b4c283e34a887f977789d00181aa3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_cf0b4c283e34a887f977789d00181aa3.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_04177136e251b97843b0418912da84c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_04177136e251b97843b0418912da84c6.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_ea9541016b0347307cc06c43f9fedf66.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_ea9541016b0347307cc06c43f9fedf66.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_5cfe712e80c9fc586c64213804c9fab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_5cfe712e80c9fc586c64213804c9fab6.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_0914a002b0265fbe1bd43d0dee506de3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0914a002b0265fbe1bd43d0dee506de3.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_0f87146e4f7b2e76c78ca1dc876548c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0f87146e4f7b2e76c78ca1dc876548c6.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_9500b01188bc656f528bba95b694b1c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_9500b01188bc656f528bba95b694b1c4.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_a56b87874b6fcf3d3efbd973df386635.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_a56b87874b6fcf3d3efbd973df386635.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_1f0c091a6356ab8bb5639da7173f3fe0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_1f0c091a6356ab8bb5639da7173f3fe0.jpg already downloaded
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fe8%252F52e840a97448283eedb15f2900a2bd00%252Fpa%252FHG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg already downloaded
2026-03-28 18:38:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45dec50c-ac33-5893-96d7-8a020af7a3b5, identifier: HG43188
2026-03-28 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_1684f72608a90767e00cbc11a7b9924f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_35d6d042675267c6f9ea6ab4121c6399.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_35d6d042675267c6f9ea6ab4121c6399.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_5f549d7d0a357ed957560a2c6565239b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_5f549d7d0a357ed957560a2c6565239b.jpg not downloaded yet
2026-03-28 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LK56613> (referer: https://www.auto1.com/v1/car-details-view/LK56613/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-03-28 18:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188
2026-03-28 18:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45dec50c-ac33-5893-96d7-8a020af7a3b5 with identifier: HG43188 to the API
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HG43188>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:51:47Z',
 'fuel_type': 'diesel',
 'id': '45dec50c-ac33-5893-96d7-8a020af7a3b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG43188',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 252957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_cf0b4c283e34a887f977789d00181aa3.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_04177136e251b97843b0418912da84c6.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_ea9541016b0347307cc06c43f9fedf66.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_5cfe712e80c9fc586c64213804c9fab6.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0914a002b0265fbe1bd43d0dee506de3.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0f87146e4f7b2e76c78ca1dc876548c6.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_9500b01188bc656f528bba95b694b1c4.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_a56b87874b6fcf3d3efbd973df386635.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_1f0c091a6356ab8bb5639da7173f3fe0.jpg',
                'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_cf0b4c283e34a887f977789d00181aa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_04177136e251b97843b0418912da84c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2388991,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_ea9541016b0347307cc06c43f9fedf66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_5cfe712e80c9fc586c64213804c9fab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2440471,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0914a002b0265fbe1bd43d0dee506de3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_0f87146e4f7b2e76c78ca1dc876548c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_9500b01188bc656f528bba95b694b1c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2424182,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_a56b87874b6fcf3d3efbd973df386635.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_1f0c091a6356ab8bb5639da7173f3fe0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_45dec50c-ac33-5893-96d7-8a020af7a3b5/45dec50c-ac33-5893-96d7-8a020af7a3b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2653089,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img52/e8/52e840a97448283eedb15f2900a2bd00/pa/HG43188_de30935b0ca51adbfcda284a61ca3b7b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2014}
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG43188%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [auto1.de] INFO: Saving data for HG43188: {'created_time': 1774723097.462095, 'last_price_update_time': 1774723097.462106, 'auction_closing_time': 1774885907.0}
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG43188') HTTP/1.1" 204 0
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_465484a76ad51f9695ce2d03b2404e80.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_465484a76ad51f9695ce2d03b2404e80.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_137c7c23f730cd1807877accc5467b46.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_137c7c23f730cd1807877accc5467b46.jpg not downloaded yet
2026-03-28 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_4d4713f2804b364fa5ea2a4a49133751.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_d488663c489dcc4a0dbd6ea592966c57.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bddafd0>
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_00409da09f6c480c67263334aa82473f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_00409da09f6c480c67263334aa82473f.jpg saved to cache
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb34790>
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_df7fc6d42f371728ed4267deb83d0af6.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_df7fc6d42f371728ed4267deb83d0af6.jpg saved to cache
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with identifier: JX30830
2026-03-28 18:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with scrape type 1
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_36cd4390ab6cd8b9e1e9a775446ce3d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_36cd4390ab6cd8b9e1e9a775446ce3d0.jpg not downloaded yet
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b289610>
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_1684f72608a90767e00cbc11a7b9924f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_1684f72608a90767e00cbc11a7b9924f.jpg saved to cache
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afb22574-3f38-5863-b9e4-e198658a431c with identifier: LK56613
2026-03-28 18:38:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb22574-3f38-5863-b9e4-e198658a431c with scrape type 1
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_b71b996f0016265239b215188e580236.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_b71b996f0016265239b215188e580236.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_b2302d67896adf9a8c7540b0914ef900.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_b2302d67896adf9a8c7540b0914ef900.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_aa72146b22773f372051a1439c7e42ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_aa72146b22773f372051a1439c7e42ff.jpg not downloaded yet
2026-03-28 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_6c3305de3ed13daaa1dca4246820879f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_b16f3dad5ee1959e33aa0157401fa9af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b16f3dad5ee1959e33aa0157401fa9af.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_0442a5a0d0cf92e24616f082c1dc25b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_0442a5a0d0cf92e24616f082c1dc25b8.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_e35fed7d9defeafb665329a6fffb5a6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_e35fed7d9defeafb665329a6fffb5a6f.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_e1460a0e09f39785daed7328086828fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_e1460a0e09f39785daed7328086828fd.jpg not downloaded yet
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe6bd0>
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_4d4713f2804b364fa5ea2a4a49133751.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_4d4713f2804b364fa5ea2a4a49133751.jpg saved to cache
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbbaad0>
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_d488663c489dcc4a0dbd6ea592966c57.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_d488663c489dcc4a0dbd6ea592966c57.jpg saved to cache
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_6a65b9f856eebfdede6924f972ed319a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_e4cc3b6c00b3dfd03658b4a4decda867.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_e4cc3b6c00b3dfd03658b4a4decda867.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_78147a3d6a45a346ead15cc03f7d037d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_78147a3d6a45a346ead15cc03f7d037d.jpg not downloaded yet
2026-03-28 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_5b5101ca3b34bd8c1bb3de85d8020a80.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_a79274622cefde4ae6a9de0811183090.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_a79274622cefde4ae6a9de0811183090.jpg not downloaded yet
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_bd325177cb5766dc7e18d7a8e50bfb56.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_bd325177cb5766dc7e18d7a8e50bfb56.jpg not downloaded yet
2026-03-28 18:38:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV68719> (referer: https://www.auto1.com/v1/car-details-view/KV68719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_b00dbc953e41f650d957ace596076f25.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b00dbc953e41f650d957ace596076f25.jpg not downloaded yet
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_a09ee329697dce0306366cd19fa11013.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_a09ee329697dce0306366cd19fa11013.jpg not downloaded yet
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1fe10>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_6c3305de3ed13daaa1dca4246820879f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_6c3305de3ed13daaa1dca4246820879f.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_7ce9a22ca09420250d03f9382f34c415.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_2a57ca92078aedd1c1d0646969d033d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_2a57ca92078aedd1c1d0646969d033d3.jpg not downloaded yet
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_24133a1af087fe49b809bc1e6ff8a66a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_24133a1af087fe49b809bc1e6ff8a66a.jpg not downloaded yet
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_b68428dd2b2136218448a450ba58d8e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b68428dd2b2136218448a450ba58d8e9.jpg not downloaded yet
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_4c050fabec2d03204a5fba97c153de86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_4c050fabec2d03204a5fba97c153de86.jpg not downloaded yet
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_9d1b101414189d6e54ead09d76f2c965.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_9d1b101414189d6e54ead09d76f2c965.jpg not downloaded yet
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b245f10>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_6a65b9f856eebfdede6924f972ed319a.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_6a65b9f856eebfdede6924f972ed319a.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb04d50>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_5b5101ca3b34bd8c1bb3de85d8020a80.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_5b5101ca3b34bd8c1bb3de85d8020a80.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_67d91447dcbf4b0753dfae93e842b920.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_1dba81fd6527e6c68ac463ea79671c01.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_4a6714bff97116876ea9bb80032288c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_4a6714bff97116876ea9bb80032288c3.jpg not downloaded yet
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_e3e9412359b2823e5201bd4f577239ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_17fba5fa58b551826a35ab5b7ceb016a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_17fba5fa58b551826a35ab5b7ceb016a.jpg not downloaded yet
2026-03-28 18:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54013860-46d6-5195-9db8-7e03037465bc with identifier: KV68719
2026-03-28 18:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54013860-46d6-5195-9db8-7e03037465bc with scrape type 1
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 54013860-46d6-5195-9db8-7e03037465bc
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_2f2d79cebcb97c1adb36e7ecbd21804b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_2f2d79cebcb97c1adb36e7ecbd21804b.jpg not downloaded yet
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d3fd0>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_7ce9a22ca09420250d03f9382f34c415.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_7ce9a22ca09420250d03f9382f34c415.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_60717e9ead3501e22bca2c9f48c8a1ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_60717e9ead3501e22bca2c9f48c8a1ec.jpg not downloaded yet
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_d59ecebfd913446b4aed558b24f50b71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_d59ecebfd913446b4aed558b24f50b71.jpg not downloaded yet
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_a171f3a6e80721dc626f3880fa8f3550.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_5f549d7d0a357ed957560a2c6565239b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb3cad0>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_67d91447dcbf4b0753dfae93e842b920.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_67d91447dcbf4b0753dfae93e842b920.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb32590>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_1dba81fd6527e6c68ac463ea79671c01.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_1dba81fd6527e6c68ac463ea79671c01.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_39e025b7f809c4cdc05fac30f2dfe559.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_39e025b7f809c4cdc05fac30f2dfe559.jpg not downloaded yet
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_ff798e47ebea4b4efb8344aa43e7e877.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_ff798e47ebea4b4efb8344aa43e7e877.jpg not downloaded yet
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be78bd0>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_e3e9412359b2823e5201bd4f577239ec.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_e3e9412359b2823e5201bd4f577239ec.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_5bf68ed66fa123b614f0ac1862eb1807.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_5bf68ed66fa123b614f0ac1862eb1807.jpg not downloaded yet
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_7b8ca3be6cd34f07bf324beedc940028.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_7b8ca3be6cd34f07bf324beedc940028.jpg not downloaded yet
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_35d6d042675267c6f9ea6ab4121c6399.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_c2a0ea2e8f506b7b2867c64a2d8e3d2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_c2a0ea2e8f506b7b2867c64a2d8e3d2f.jpg not downloaded yet
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b2ed0>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_a171f3a6e80721dc626f3880fa8f3550.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_a171f3a6e80721dc626f3880fa8f3550.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bde6910>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_5f549d7d0a357ed957560a2c6565239b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_5f549d7d0a357ed957560a2c6565239b.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_d24de2f66d18e87ceefbca3cdbd0e02d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_748b5a2259567b0d28de13bed8dfab1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_082f0ee612ffc390f05f8e350a2ed987.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_aa72146b22773f372051a1439c7e42ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_b6e5c05b44566e00af6e56fbcd17eb51.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8cbd0>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_35d6d042675267c6f9ea6ab4121c6399.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_35d6d042675267c6f9ea6ab4121c6399.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_2f3e676cc78a2b26f34aef6291e6b709.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_0442a5a0d0cf92e24616f082c1dc25b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b68428dd2b2136218448a450ba58d8e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_e4cc3b6c00b3dfd03658b4a4decda867.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c4850>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_d24de2f66d18e87ceefbca3cdbd0e02d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_d24de2f66d18e87ceefbca3cdbd0e02d.jpg saved to cache
2026-03-28 18:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_2f2d79cebcb97c1adb36e7ecbd21804b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_7b8ca3be6cd34f07bf324beedc940028.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_17fba5fa58b551826a35ab5b7ceb016a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_78147a3d6a45a346ead15cc03f7d037d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_c2a0ea2e8f506b7b2867c64a2d8e3d2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd59bd0>
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_748b5a2259567b0d28de13bed8dfab1c.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_748b5a2259567b0d28de13bed8dfab1c.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd68210>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_082f0ee612ffc390f05f8e350a2ed987.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_082f0ee612ffc390f05f8e350a2ed987.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b15d290>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_aa72146b22773f372051a1439c7e42ff.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_aa72146b22773f372051a1439c7e42ff.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb3710>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_b6e5c05b44566e00af6e56fbcd17eb51.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_b6e5c05b44566e00af6e56fbcd17eb51.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be72f50>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_2f3e676cc78a2b26f34aef6291e6b709.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_2f3e676cc78a2b26f34aef6291e6b709.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda5b50>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_0442a5a0d0cf92e24616f082c1dc25b8.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_0442a5a0d0cf92e24616f082c1dc25b8.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdbc5d0>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_b68428dd2b2136218448a450ba58d8e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b68428dd2b2136218448a450ba58d8e9.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc8a590>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_e4cc3b6c00b3dfd03658b4a4decda867.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_e4cc3b6c00b3dfd03658b4a4decda867.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb3d750>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_2f2d79cebcb97c1adb36e7ecbd21804b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_2f2d79cebcb97c1adb36e7ecbd21804b.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54013860-46d6-5195-9db8-7e03037465bc
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b104f10>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_7b8ca3be6cd34f07bf324beedc940028.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_7b8ca3be6cd34f07bf324beedc940028.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54013860-46d6-5195-9db8-7e03037465bc
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be8a9d0>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_17fba5fa58b551826a35ab5b7ceb016a.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_17fba5fa58b551826a35ab5b7ceb016a.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2ac3d0>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_78147a3d6a45a346ead15cc03f7d037d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_78147a3d6a45a346ead15cc03f7d037d.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be92fd0>
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_c2a0ea2e8f506b7b2867c64a2d8e3d2f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_c2a0ea2e8f506b7b2867c64a2d8e3d2f.jpg saved to cache
2026-03-28 18:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54013860-46d6-5195-9db8-7e03037465bc
2026-03-28 18:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_4c050fabec2d03204a5fba97c153de86.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_4a6714bff97116876ea9bb80032288c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_bd325177cb5766dc7e18d7a8e50bfb56.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_39e025b7f809c4cdc05fac30f2dfe559.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be93e50>
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_4c050fabec2d03204a5fba97c153de86.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_4c050fabec2d03204a5fba97c153de86.jpg saved to cache
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_ff798e47ebea4b4efb8344aa43e7e877.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_d59ecebfd913446b4aed558b24f50b71.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc9a910>
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_4a6714bff97116876ea9bb80032288c3.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_4a6714bff97116876ea9bb80032288c3.jpg saved to cache
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beb3ed0>
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_bd325177cb5766dc7e18d7a8e50bfb56.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_bd325177cb5766dc7e18d7a8e50bfb56.jpg saved to cache
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd78790>
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_39e025b7f809c4cdc05fac30f2dfe559.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_39e025b7f809c4cdc05fac30f2dfe559.jpg saved to cache
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_a09ee329697dce0306366cd19fa11013.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b00dbc953e41f650d957ace596076f25.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_a79274622cefde4ae6a9de0811183090.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_5bf68ed66fa123b614f0ac1862eb1807.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd4a310>
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_ff798e47ebea4b4efb8344aa43e7e877.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_ff798e47ebea4b4efb8344aa43e7e877.jpg saved to cache
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54013860-46d6-5195-9db8-7e03037465bc
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0e250>
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcc%252Fb3%252Fccb35e692edc412ddf4af23a6e706a20%252Fpa%252FKV68719_d59ecebfd913446b4aed558b24f50b71.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_d59ecebfd913446b4aed558b24f50b71.jpg saved to cache
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54013860-46d6-5195-9db8-7e03037465bc
2026-03-28 18:38:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54013860-46d6-5195-9db8-7e03037465bc, skipping ID generation
2026-03-28 18:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54013860-46d6-5195-9db8-7e03037465bc with scrape type 1
2026-03-28 18:38:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54013860-46d6-5195-9db8-7e03037465bc sending to next pipeline
2026-03-28 18:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54013860-46d6-5195-9db8-7e03037465bc, identifier: KV68719
2026-03-28 18:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54013860-46d6-5195-9db8-7e03037465bc with identifier: KV68719
2026-03-28 18:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54013860-46d6-5195-9db8-7e03037465bc with identifier: KV68719
2026-03-28 18:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54013860-46d6-5195-9db8-7e03037465bc with identifier: KV68719 to the API
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_d59ecebfd913446b4aed558b24f50b71.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 226,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:38:17Z',
 'fuel_type': 'petrol',
 'id': '54013860-46d6-5195-9db8-7e03037465bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV68719',
 'listing': 'auction',
 'location': 'DE, Böblingen',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 222142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_2f2d79cebcb97c1adb36e7ecbd21804b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_d59ecebfd913446b4aed558b24f50b71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_ff798e47ebea4b4efb8344aa43e7e877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_7b8ca3be6cd34f07bf324beedc940028.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54013860-46d6-5195-9db8-7e03037465bc/54013860-46d6-5195-9db8-7e03037465bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 134141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcc/b3/ccb35e692edc412ddf4af23a6e706a20/pa/KV68719_c2a0ea2e8f506b7b2867c64a2d8e3d2f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV68719%27 HTTP/1.1" 200 None
2026-03-28 18:38:21 [auto1.de] INFO: Saving data for KV68719: {'created_time': 1774723101.394687, 'last_price_update_time': 1774723101.394698, 'auction_closing_time': 1774885097.0}
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV68719') HTTP/1.1" 204 0
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_e1460a0e09f39785daed7328086828fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b16f3dad5ee1959e33aa0157401fa9af.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_e35fed7d9defeafb665329a6fffb5a6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26ec10>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_a09ee329697dce0306366cd19fa11013.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_a09ee329697dce0306366cd19fa11013.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b58be6a10>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_b00dbc953e41f650d957ace596076f25.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b00dbc953e41f650d957ace596076f25.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be900d0>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_a79274622cefde4ae6a9de0811183090.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_a79274622cefde4ae6a9de0811183090.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb20810>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_5bf68ed66fa123b614f0ac1862eb1807.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_5bf68ed66fa123b614f0ac1862eb1807.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_b71b996f0016265239b215188e580236.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd57810>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_e1460a0e09f39785daed7328086828fd.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_e1460a0e09f39785daed7328086828fd.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb0450>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_b16f3dad5ee1959e33aa0157401fa9af.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b16f3dad5ee1959e33aa0157401fa9af.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd54e50>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_e35fed7d9defeafb665329a6fffb5a6f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_e35fed7d9defeafb665329a6fffb5a6f.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_137c7c23f730cd1807877accc5467b46.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_36cd4390ab6cd8b9e1e9a775446ce3d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf6610>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_b71b996f0016265239b215188e580236.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_b71b996f0016265239b215188e580236.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_465484a76ad51f9695ce2d03b2404e80.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_2a57ca92078aedd1c1d0646969d033d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_9d1b101414189d6e54ead09d76f2c965.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_24133a1af087fe49b809bc1e6ff8a66a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_60717e9ead3501e22bca2c9f48c8a1ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_b2302d67896adf9a8c7540b0914ef900.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc234d0>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_137c7c23f730cd1807877accc5467b46.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_137c7c23f730cd1807877accc5467b46.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda3990>
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252Fe5%252Fdbe503366e7debfaac82e717a7a2d52b%252Fpa%252FJX30830_36cd4390ab6cd8b9e1e9a775446ce3d0.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_36cd4390ab6cd8b9e1e9a775446ce3d0.jpg saved to cache
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0
2026-03-28 18:38:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd762ccb-97d1-5580-93e5-cd537b5f9ea0, skipping ID generation
2026-03-28 18:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with scrape type 1
2026-03-28 18:38:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd762ccb-97d1-5580-93e5-cd537b5f9ea0 sending to next pipeline
2026-03-28 18:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd762ccb-97d1-5580-93e5-cd537b5f9ea0, identifier: JX30830
2026-03-28 18:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with identifier: JX30830
2026-03-28 18:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with identifier: JX30830
2026-03-28 18:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd762ccb-97d1-5580-93e5-cd537b5f9ea0 with identifier: JX30830 to the API
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_36cd4390ab6cd8b9e1e9a775446ce3d0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:17:05Z',
 'fuel_type': 'petrol',
 'id': 'fd762ccb-97d1-5580-93e5-cd537b5f9ea0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX30830',
 'listing': 'auction',
 'location': 'DE, Deggendorf',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 148460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92885,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_36cd4390ab6cd8b9e1e9a775446ce3d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b16f3dad5ee1959e33aa0157401fa9af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82972,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_e4cc3b6c00b3dfd03658b4a4decda867.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b00dbc953e41f650d957ace596076f25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd762ccb-97d1-5580-93e5-cd537b5f9ea0/fd762ccb-97d1-5580-93e5-cd537b5f9ea0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/e5/dbe503366e7debfaac82e717a7a2d52b/pa/JX30830_b68428dd2b2136218448a450ba58d8e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI GT Sport',
 'transmission': 'manual',
 'trim': 'GT Sport',
 'year': 2007}
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX30830%27 HTTP/1.1" 200 None
2026-03-28 18:38:22 [auto1.de] INFO: Saving data for JX30830: {'created_time': 1774723102.497863, 'last_price_update_time': 1774723102.497872, 'auction_closing_time': 1774883825.0}
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX30830') HTTP/1.1" 204 0
2026-03-28 18:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_22d51c5f7246afa1777bc75206fb8ec8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_752a60e969ac7cd524b599c9cf7cb7b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_3eb100908445b31b50808e90acc6b895.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG29438> (referer: https://www.auto1.com/v1/car-details-view/UG29438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beae510>
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_465484a76ad51f9695ce2d03b2404e80.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_465484a76ad51f9695ce2d03b2404e80.jpg saved to cache
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59cf6910>
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_2a57ca92078aedd1c1d0646969d033d3.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_2a57ca92078aedd1c1d0646969d033d3.jpg saved to cache
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda9810>
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_9d1b101414189d6e54ead09d76f2c965.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_9d1b101414189d6e54ead09d76f2c965.jpg saved to cache
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59cf4690>
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252Fc6%252F5cc6af593a986b18a1a2098189127e0a%252Fpa%252FKD63113_24133a1af087fe49b809bc1e6ff8a66a.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_24133a1af087fe49b809bc1e6ff8a66a.jpg saved to cache
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91fbfd3b-6a4b-5490-8430-5cf09c235677
2026-03-28 18:38:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91fbfd3b-6a4b-5490-8430-5cf09c235677, skipping ID generation
2026-03-28 18:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91fbfd3b-6a4b-5490-8430-5cf09c235677 with scrape type 1
2026-03-28 18:38:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91fbfd3b-6a4b-5490-8430-5cf09c235677 sending to next pipeline
2026-03-28 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91fbfd3b-6a4b-5490-8430-5cf09c235677, identifier: KD63113
2026-03-28 18:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b6797bf90>
2026-03-28 18:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge0%252F3b%252Fe03b8ef283fddc64215e222a016f1e0e%252Fpa%252FLK56613_60717e9ead3501e22bca2c9f48c8a1ec.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_60717e9ead3501e22bca2c9f48c8a1ec.jpg saved to cache
2026-03-28 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item afb22574-3f38-5863-b9e4-e198658a431c
2026-03-28 18:38:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: afb22574-3f38-5863-b9e4-e198658a431c, skipping ID generation
2026-03-28 18:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb22574-3f38-5863-b9e4-e198658a431c with scrape type 1
2026-03-28 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item afb22574-3f38-5863-b9e4-e198658a431c sending to next pipeline
2026-03-28 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afb22574-3f38-5863-b9e4-e198658a431c, identifier: LK56613
2026-03-28 18:38:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdab290>
2026-03-28 18:38:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9a%252F06%252F9a06c27380823dacfd890648af5a6825%252Fpa%252FWF14307_b2302d67896adf9a8c7540b0914ef900.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_b2302d67896adf9a8c7540b0914ef900.jpg saved to cache
2026-03-28 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a2a6e24-e275-5c8f-977e-046dea6e023d
2026-03-28 18:38:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a2a6e24-e275-5c8f-977e-046dea6e023d, skipping ID generation
2026-03-28 18:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2a6e24-e275-5c8f-977e-046dea6e023d with scrape type 1
2026-03-28 18:38:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a2a6e24-e275-5c8f-977e-046dea6e023d sending to next pipeline
2026-03-28 18:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a2a6e24-e275-5c8f-977e-046dea6e023d, identifier: WF14307
2026-03-28 18:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91fbfd3b-6a4b-5490-8430-5cf09c235677 with identifier: KD63113
2026-03-28 18:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91fbfd3b-6a4b-5490-8430-5cf09c235677 with identifier: KD63113
2026-03-28 18:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91fbfd3b-6a4b-5490-8430-5cf09c235677 with identifier: KD63113 to the API
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_24133a1af087fe49b809bc1e6ff8a66a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 257,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '5.0L',
 'engine_horse_power': 449,
 'expiration_date': '2026-03-30T15:54:23Z',
 'fuel_type': 'petrol',
 'id': '91fbfd3b-6a4b-5490-8430-5cf09c235677',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD63113',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 34141,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_1dba81fd6527e6c68ac463ea79671c01.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_7ce9a22ca09420250d03f9382f34c415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_6a65b9f856eebfdede6924f972ed319a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_5f549d7d0a357ed957560a2c6565239b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_137c7c23f730cd1807877accc5467b46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102770,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_aa72146b22773f372051a1439c7e42ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_e1460a0e09f39785daed7328086828fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3351586,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_bd325177cb5766dc7e18d7a8e50bfb56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3298729,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_24133a1af087fe49b809bc1e6ff8a66a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91fbfd3b-6a4b-5490-8430-5cf09c235677/91fbfd3b-6a4b-5490-8430-5cf09c235677_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3076267,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/c6/5cc6af593a986b18a1a2098189127e0a/pa/KD63113_9d1b101414189d6e54ead09d76f2c965.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD63113%27 HTTP/1.1" 200 None
2026-03-28 18:38:23 [auto1.de] INFO: Saving data for KD63113: {'created_time': 1774723103.836504, 'last_price_update_time': 1774723103.836515, 'auction_closing_time': 1774886063.0}
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KD63113') HTTP/1.1" 204 0
2026-03-28 18:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afb22574-3f38-5863-b9e4-e198658a431c with identifier: LK56613
2026-03-28 18:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afb22574-3f38-5863-b9e4-e198658a431c with identifier: LK56613
2026-03-28 18:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afb22574-3f38-5863-b9e4-e198658a431c with identifier: LK56613 to the API
2026-03-28 18:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_60717e9ead3501e22bca2c9f48c8a1ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 269,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '5.0L',
 'engine_horse_power': 550,
 'expiration_date': '2026-03-30T15:03:49Z',
 'fuel_type': 'petrol',
 'id': 'afb22574-3f38-5863-b9e4-e198658a431c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK56613',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Jaguar',
 'model': 'F-TYPE',
 'odometer': 126215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_b71b996f0016265239b215188e580236.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_0442a5a0d0cf92e24616f082c1dc25b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_78147a3d6a45a346ead15cc03f7d037d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_a09ee329697dce0306366cd19fa11013.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3113256,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_4c050fabec2d03204a5fba97c153de86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3102586,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_4a6714bff97116876ea9bb80032288c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_17fba5fa58b551826a35ab5b7ceb016a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3072042,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_60717e9ead3501e22bca2c9f48c8a1ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_39e025b7f809c4cdc05fac30f2dfe559.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_afb22574-3f38-5863-b9e4-e198658a431c/afb22574-3f38-5863-b9e4-e198658a431c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660807,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge0/3b/e03b8ef283fddc64215e222a016f1e0e/pa/LK56613_5bf68ed66fa123b614f0ac1862eb1807.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-30',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Jaguar F-TYPE 5.0 V8 R AWD',
 'transmission': 'automatic',
 'trim': 'R AWD',
 'year': 2016}
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK56613%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Saving data for LK56613: {'created_time': 1774723104.264065, 'last_price_update_time': 1774723104.264079, 'auction_closing_time': 1774883029.0}
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK56613') HTTP/1.1" 204 0
2026-03-28 18:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a2a6e24-e275-5c8f-977e-046dea6e023d with identifier: WF14307
2026-03-28 18:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a2a6e24-e275-5c8f-977e-046dea6e023d with identifier: WF14307
2026-03-28 18:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a2a6e24-e275-5c8f-977e-046dea6e023d with identifier: WF14307 to the API
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_b2302d67896adf9a8c7540b0914ef900.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'petrol',
 'id': '5a2a6e24-e275-5c8f-977e-046dea6e023d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF14307',
 'listing': 'auction',
 'location': 'DE, Neustadt an der Weinstraße',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 150463,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_a171f3a6e80721dc626f3880fa8f3550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_e3e9412359b2823e5201bd4f577239ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_67d91447dcbf4b0753dfae93e842b920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_5b5101ca3b34bd8c1bb3de85d8020a80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_35d6d042675267c6f9ea6ab4121c6399.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_465484a76ad51f9695ce2d03b2404e80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769750,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_b2302d67896adf9a8c7540b0914ef900.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_e35fed7d9defeafb665329a6fffb5a6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_a79274622cefde4ae6a9de0811183090.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a2a6e24-e275-5c8f-977e-046dea6e023d/5a2a6e24-e275-5c8f-977e-046dea6e023d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2700311,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9a/06/9a06c27380823dacfd890648af5a6825/pa/WF14307_2a57ca92078aedd1c1d0646969d033d3.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2009}
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF14307%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [auto1.de] INFO: Saving data for WF14307: {'created_time': 1774723104.690996, 'last_price_update_time': 1774723104.691011, 'auction_closing_time': 1774885866.0}
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF14307') HTTP/1.1" 204 0
2026-03-28 18:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV53465> (referer: https://www.auto1.com/v1/car-details-view/TV53465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda4990>
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_22d51c5f7246afa1777bc75206fb8ec8.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_22d51c5f7246afa1777bc75206fb8ec8.jpg saved to cache
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb5e0d0>
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_752a60e969ac7cd524b599c9cf7cb7b5.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_752a60e969ac7cd524b599c9cf7cb7b5.jpg saved to cache
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd49590>
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_3eb100908445b31b50808e90acc6b895.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_3eb100908445b31b50808e90acc6b895.jpg saved to cache
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with identifier: UG29438
2026-03-28 18:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with scrape type 1
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_80cca09f8c1477f83db35c6a173db2a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_80cca09f8c1477f83db35c6a173db2a6.jpg not downloaded yet
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_2c56e8763977028165557a22ca65d2fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_2c56e8763977028165557a22ca65d2fa.jpg not downloaded yet
2026-03-28 18:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77b69424-bb8b-5763-accf-ed3c86f3729f with identifier: TV53465
2026-03-28 18:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77b69424-bb8b-5763-accf-ed3c86f3729f with scrape type 1
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77b69424-bb8b-5763-accf-ed3c86f3729f
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_49abadf06c6cb1cc5f822f7cb7b5c7ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_49abadf06c6cb1cc5f822f7cb7b5c7ba.jpg already downloaded
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_912d7052b1017e74e3eb3c3acb2566dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_912d7052b1017e74e3eb3c3acb2566dd.jpg already downloaded
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_82ffde95afb09ad6b11a4f963600e6a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_82ffde95afb09ad6b11a4f963600e6a0.jpg already downloaded
2026-03-28 18:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_e2f40c9597f3ad93c1bf0f9965ab7fb3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_e2f40c9597f3ad93c1bf0f9965ab7fb3.jpg already downloaded
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_4fd51bf3269872d0d6958f27f7b0c260.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_4fd51bf3269872d0d6958f27f7b0c260.jpg already downloaded
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_16720adfabc6498772761a1dc4e39462.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_16720adfabc6498772761a1dc4e39462.jpg already downloaded
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_d1e398da4e70cb97a4f574c23df30024.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_d1e398da4e70cb97a4f574c23df30024.jpg already downloaded
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_556e2f32a353a69f58f94c43e06796d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_556e2f32a353a69f58f94c43e06796d8.jpg already downloaded
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_d4a116ed24f915b18648e647c660a74f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_d4a116ed24f915b18648e647c660a74f.jpg already downloaded
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Faf%252F59af168c5351ed723c6530bb55a48d6c%252Fpa%252FTV53465_3e569ea5be64c2de6618c125431e3614.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_3e569ea5be64c2de6618c125431e3614.jpg already downloaded
2026-03-28 18:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77b69424-bb8b-5763-accf-ed3c86f3729f, identifier: TV53465
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_c4c5ea766b938b481170ec67879032ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_c4c5ea766b938b481170ec67879032ba.jpg not downloaded yet
2026-03-28 18:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77b69424-bb8b-5763-accf-ed3c86f3729f with identifier: TV53465
2026-03-28 18:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77b69424-bb8b-5763-accf-ed3c86f3729f with identifier: TV53465
2026-03-28 18:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77b69424-bb8b-5763-accf-ed3c86f3729f with identifier: TV53465 to the API
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TV53465>
{'auction_title': '',
 'c_o_2_emission_value': 238,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:10:59Z',
 'fuel_type': 'diesel',
 'id': '77b69424-bb8b-5763-accf-ed3c86f3729f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV53465',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 105467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_49abadf06c6cb1cc5f822f7cb7b5c7ba.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_912d7052b1017e74e3eb3c3acb2566dd.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_82ffde95afb09ad6b11a4f963600e6a0.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_e2f40c9597f3ad93c1bf0f9965ab7fb3.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_4fd51bf3269872d0d6958f27f7b0c260.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_16720adfabc6498772761a1dc4e39462.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_d1e398da4e70cb97a4f574c23df30024.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_556e2f32a353a69f58f94c43e06796d8.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_d4a116ed24f915b18648e647c660a74f.jpg',
                'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_3e569ea5be64c2de6618c125431e3614.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85324,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_49abadf06c6cb1cc5f822f7cb7b5c7ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_912d7052b1017e74e3eb3c3acb2566dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_82ffde95afb09ad6b11a4f963600e6a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_e2f40c9597f3ad93c1bf0f9965ab7fb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_4fd51bf3269872d0d6958f27f7b0c260.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_16720adfabc6498772761a1dc4e39462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_d1e398da4e70cb97a4f574c23df30024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_556e2f32a353a69f58f94c43e06796d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_d4a116ed24f915b18648e647c660a74f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77b69424-bb8b-5763-accf-ed3c86f3729f/77b69424-bb8b-5763-accf-ed3c86f3729f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/af/59af168c5351ed723c6530bb55a48d6c/pa/TV53465_3e569ea5be64c2de6618c125431e3614.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-20',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Opel Movano 2.5 CDTI L1H1 Ka 3,5t',
 'transmission': 'manual',
 'trim': 'L1H1 Ka 3,5t',
 'year': 2010}
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV53465%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [auto1.de] INFO: Saving data for TV53465: {'created_time': 1774723105.561843, 'last_price_update_time': 1774723105.561854, 'auction_closing_time': 1774883459.0}
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV53465') HTTP/1.1" 204 0
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_4a72b6393c6a57965e4a140775f4a7fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_4a72b6393c6a57965e4a140775f4a7fc.jpg not downloaded yet
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_80cca09f8c1477f83db35c6a173db2a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_659f83c8b677b8778a7434e254238088.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_fad4599a8ff0d901521994c47b2fd588.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV17598> (referer: https://www.auto1.com/v1/car-details-view/KV17598/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_7ee0aed38a26772b09fd43ad28666eb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_7ee0aed38a26772b09fd43ad28666eb2.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_b727981b4cb96449e68951348f7603a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_b727981b4cb96449e68951348f7603a4.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_dce0c86215b83d081d6e8ac28ff76aec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_dce0c86215b83d081d6e8ac28ff76aec.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_2accdadda9c82b4378efe76d300dd9a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_2accdadda9c82b4378efe76d300dd9a1.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_1bad12f254481b984ab4a5055685b230.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_1bad12f254481b984ab4a5055685b230.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_c81774af966407b8d3b96bbd9598434b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_c81774af966407b8d3b96bbd9598434b.jpg not downloaded yet
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8de10>
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_80cca09f8c1477f83db35c6a173db2a6.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_80cca09f8c1477f83db35c6a173db2a6.jpg saved to cache
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb2e90>
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_659f83c8b677b8778a7434e254238088.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_659f83c8b677b8778a7434e254238088.jpg saved to cache
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbe9650>
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_fad4599a8ff0d901521994c47b2fd588.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_fad4599a8ff0d901521994c47b2fd588.jpg saved to cache
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcdb427a-16cc-5853-abb5-e19121cdde3a with identifier: KV17598
2026-03-28 18:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdb427a-16cc-5853-abb5-e19121cdde3a with scrape type 1
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_032e679ff2ad58d5a8eb3b0a9e46510f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_032e679ff2ad58d5a8eb3b0a9e46510f.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_b6a50b18f988c91f1133dbae7aa15f9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_b6a50b18f988c91f1133dbae7aa15f9e.jpg not downloaded yet
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ef9932c527f9390b8a32682f1b0ef20d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_a4b7c5b2d8c3b6a26f2645c1f2509d04.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_434a46270960bcbf9005b1c995c18b60.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_557dc2ae6c621a4ac468b9dbc6b6f888.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_557dc2ae6c621a4ac468b9dbc6b6f888.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_1b49e050999da1bc1c272de6824a8e5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_1b49e050999da1bc1c272de6824a8e5d.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_1a89e0f574920a18d4332ef8c51cb99a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_1a89e0f574920a18d4332ef8c51cb99a.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_c2b4ba5fd08528cf5164cd01c75c0148.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_c2b4ba5fd08528cf5164cd01c75c0148.jpg not downloaded yet
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_fe544950c98cf95486026f6d9748e96c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_fe544950c98cf95486026f6d9748e96c.jpg not downloaded yet
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_a8e03466c3d4def81860128238d86ebe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_a8e03466c3d4def81860128238d86ebe.jpg not downloaded yet
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd58d90>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_ef9932c527f9390b8a32682f1b0ef20d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ef9932c527f9390b8a32682f1b0ef20d.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a5bd0>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_a4b7c5b2d8c3b6a26f2645c1f2509d04.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_a4b7c5b2d8c3b6a26f2645c1f2509d04.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb94f50>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_434a46270960bcbf9005b1c995c18b60.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_434a46270960bcbf9005b1c995c18b60.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_33bdc3eefc49f90413e8ab23f541bcd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_33bdc3eefc49f90413e8ab23f541bcd3.jpg not downloaded yet
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_c4c5ea766b938b481170ec67879032ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_13896d92cbe9d44af08e25be4c0ef062.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_2c56e8763977028165557a22ca65d2fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_89386bd01a158b0b6f27c57b166658d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_89386bd01a158b0b6f27c57b166658d9.jpg not downloaded yet
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_3193a08662b5e965a05f136e6d1683ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_74e64d0c609db7383e0efd4b9c063af0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_e6df4443bdacfdec403e56f39206c54e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_aea620f4e1b05d3e991341ea23b2a927.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_a4051500e5742750bc6a7ca356720ad1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_33bdc3eefc49f90413e8ab23f541bcd3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdd2250>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_c4c5ea766b938b481170ec67879032ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_c4c5ea766b938b481170ec67879032ba.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10d8d0>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_13896d92cbe9d44af08e25be4c0ef062.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_13896d92cbe9d44af08e25be4c0ef062.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc31c50>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_2c56e8763977028165557a22ca65d2fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_2c56e8763977028165557a22ca65d2fa.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_b6a50b18f988c91f1133dbae7aa15f9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_4a72b6393c6a57965e4a140775f4a7fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_eba9fea970e174b8e9cd1d2304607690.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc88210>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_3193a08662b5e965a05f136e6d1683ed.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_3193a08662b5e965a05f136e6d1683ed.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb0790>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252F94%252F929449e4e7999ca9ddf572480cfba9f2%252Fpa%252FUN89180_74e64d0c609db7383e0efd4b9c063af0.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_74e64d0c609db7383e0efd4b9c063af0.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb
2026-03-28 18:38:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5fb06940-f82d-57ef-b024-a09fe65c2cbb, skipping ID generation
2026-03-28 18:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb with scrape type 1
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5fb06940-f82d-57ef-b024-a09fe65c2cbb sending to next pipeline
2026-03-28 18:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fb06940-f82d-57ef-b024-a09fe65c2cbb, identifier: UN89180
2026-03-28 18:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd82990>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_e6df4443bdacfdec403e56f39206c54e.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_e6df4443bdacfdec403e56f39206c54e.jpg saved to cache
2026-03-28 18:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a7410>
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_aea620f4e1b05d3e991341ea23b2a927.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_aea620f4e1b05d3e991341ea23b2a927.jpg saved to cache
2026-03-28 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda6110>
2026-03-28 18:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg24%252Fac%252F24acc6173eeb282ef16a078f12bdf764%252Fpa%252FXZ21442_a4051500e5742750bc6a7ca356720ad1.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_a4051500e5742750bc6a7ca356720ad1.jpg saved to cache
2026-03-28 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93d26785-fd90-52b9-85c8-3213dce4b022
2026-03-28 18:38:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93d26785-fd90-52b9-85c8-3213dce4b022, skipping ID generation
2026-03-28 18:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93d26785-fd90-52b9-85c8-3213dce4b022 with scrape type 1
2026-03-28 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93d26785-fd90-52b9-85c8-3213dce4b022 sending to next pipeline
2026-03-28 18:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93d26785-fd90-52b9-85c8-3213dce4b022, identifier: XZ21442
2026-03-28 18:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be80690>
2026-03-28 18:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_33bdc3eefc49f90413e8ab23f541bcd3.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_33bdc3eefc49f90413e8ab23f541bcd3.jpg saved to cache
2026-03-28 18:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW85183> (referer: https://www.auto1.com/v1/car-details-view/CW85183/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KA54911/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fb06940-f82d-57ef-b024-a09fe65c2cbb with identifier: UN89180
2026-03-28 18:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fb06940-f82d-57ef-b024-a09fe65c2cbb with identifier: UN89180
2026-03-28 18:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fb06940-f82d-57ef-b024-a09fe65c2cbb with identifier: UN89180 to the API
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_74e64d0c609db7383e0efd4b9c063af0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:55Z',
 'fuel_type': 'diesel',
 'id': '5fb06940-f82d-57ef-b024-a09fe65c2cbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN89180',
 'listing': 'auction',
 'location': 'DE, Lutherstadt Wittenberg',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 181732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2961439,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_3193a08662b5e965a05f136e6d1683ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_fa91736aa5fc43186213fc0cede95877.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3037717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_74e64d0c609db7383e0efd4b9c063af0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_22d51c5f7246afa1777bc75206fb8ec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_6c3305de3ed13daaa1dca4246820879f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_d488663c489dcc4a0dbd6ea592966c57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3066744,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_748b5a2259567b0d28de13bed8dfab1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76159,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_df7fc6d42f371728ed4267deb83d0af6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68032,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_00409da09f6c480c67263334aa82473f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5fb06940-f82d-57ef-b024-a09fe65c2cbb/5fb06940-f82d-57ef-b024-a09fe65c2cbb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2879193,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img92/94/929449e4e7999ca9ddf572480cfba9f2/pa/UN89180_082f0ee612ffc390f05f8e350a2ed987.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN89180%27 HTTP/1.1" 200 None
2026-03-28 18:38:27 [auto1.de] INFO: Saving data for UN89180: {'created_time': 1774723107.717739, 'last_price_update_time': 1774723107.717751, 'auction_closing_time': 1774885075.0}
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN89180') HTTP/1.1" 204 0
2026-03-28 18:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93d26785-fd90-52b9-85c8-3213dce4b022 with identifier: XZ21442
2026-03-28 18:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93d26785-fd90-52b9-85c8-3213dce4b022 with identifier: XZ21442
2026-03-28 18:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93d26785-fd90-52b9-85c8-3213dce4b022 with identifier: XZ21442 to the API
2026-03-28 18:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_a4051500e5742750bc6a7ca356720ad1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:33:03Z',
 'fuel_type': 'petrol',
 'id': '93d26785-fd90-52b9-85c8-3213dce4b022',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ21442',
 'listing': 'auction',
 'location': 'DE, Mainz',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 74935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3303611,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_a4051500e5742750bc6a7ca356720ad1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3173780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_aea620f4e1b05d3e991341ea23b2a927.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3159928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_e6df4443bdacfdec403e56f39206c54e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_3eb100908445b31b50808e90acc6b895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_752a60e969ac7cd524b599c9cf7cb7b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_4d4713f2804b364fa5ea2a4a49133751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3228663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_b6e5c05b44566e00af6e56fbcd17eb51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3196547,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_d24de2f66d18e87ceefbca3cdbd0e02d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_1684f72608a90767e00cbc11a7b9924f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93d26785-fd90-52b9-85c8-3213dce4b022/93d26785-fd90-52b9-85c8-3213dce4b022_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3228872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img24/ac/24acc6173eeb282ef16a078f12bdf764/pa/XZ21442_2f3e676cc78a2b26f34aef6291e6b709.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ21442%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [auto1.de] INFO: Saving data for XZ21442: {'created_time': 1774723108.14413, 'last_price_update_time': 1774723108.144143, 'auction_closing_time': 1774884783.0}
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ21442') HTTP/1.1" 204 0
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG42804> (referer: https://www.auto1.com/v1/car-details-view/BG42804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc15910>
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_b6a50b18f988c91f1133dbae7aa15f9e.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_b6a50b18f988c91f1133dbae7aa15f9e.jpg saved to cache
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26d690>
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_4a72b6393c6a57965e4a140775f4a7fc.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_4a72b6393c6a57965e4a140775f4a7fc.jpg saved to cache
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d47b90>
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_eba9fea970e174b8e9cd1d2304607690.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_eba9fea970e174b8e9cd1d2304607690.jpg saved to cache
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6712172-10f3-5907-b451-656f07af9e82 with identifier: CW85183
2026-03-28 18:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6712172-10f3-5907-b451-656f07af9e82 with scrape type 1
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_0875cb7c8d38852f4dc06f9175494e23.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_0875cb7c8d38852f4dc06f9175494e23.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_3bfa134858a21392d2e5c8515203f751.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_3bfa134858a21392d2e5c8515203f751.jpg not downloaded yet
2026-03-28 18:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327845dc-8708-5969-b7b7-75cb2251fa87 with identifier: BG42804
2026-03-28 18:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327845dc-8708-5969-b7b7-75cb2251fa87 with scrape type 1
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_1048420864b323ed1da93551e088ffa6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_1048420864b323ed1da93551e088ffa6.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_71f42c99ac7fdde12a64ee50d80bf11d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_71f42c99ac7fdde12a64ee50d80bf11d.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_eb2945ace07da3c525611c8d16945703.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_eb2945ace07da3c525611c8d16945703.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_9d8836113903d650d4bf2eb3898b7537.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_9d8836113903d650d4bf2eb3898b7537.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_677b13edc977d2238e9f282634bf3fbc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_677b13edc977d2238e9f282634bf3fbc.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_6463323f9c98d66fc084fa5b9370c23f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_6463323f9c98d66fc084fa5b9370c23f.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_88dd74839ec74ca8488123dd5121ad87.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_88dd74839ec74ca8488123dd5121ad87.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_4d83da2e8aa3b4cd1efaa73bdbb77c30.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_4d83da2e8aa3b4cd1efaa73bdbb77c30.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_653dc9b0528eafcc110b985cdfba1e7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_653dc9b0528eafcc110b985cdfba1e7b.jpg not downloaded yet
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_c2b4ba5fd08528cf5164cd01c75c0148.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_1a89e0f574920a18d4332ef8c51cb99a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_1b49e050999da1bc1c272de6824a8e5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_639e3ff84e62b72dc1de176d6b60b58b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_639e3ff84e62b72dc1de176d6b60b58b.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_0b8f6f564ecc68b163b8682608a061ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_0b8f6f564ecc68b163b8682608a061ff.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_4969d34f1b8e08e7bbbde90c8d0cf3b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_4969d34f1b8e08e7bbbde90c8d0cf3b8.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_d353be4e1a175db14fc50189f202be13.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_d353be4e1a175db14fc50189f202be13.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_e6c589b8dfbbccfcbce7a9f3d2bf2045.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_e6c589b8dfbbccfcbce7a9f3d2bf2045.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_8c9911b2ca9aef98efe1ed1fa1b2f7ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_8c9911b2ca9aef98efe1ed1fa1b2f7ea.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_011b191f5278239ee28874752f4eaf71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_011b191f5278239ee28874752f4eaf71.jpg not downloaded yet
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_bddb5ca5086d953d5a1e37c6f475edd3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_bddb5ca5086d953d5a1e37c6f475edd3.jpg not downloaded yet
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb4090>
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_c2b4ba5fd08528cf5164cd01c75c0148.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_c2b4ba5fd08528cf5164cd01c75c0148.jpg saved to cache
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc30f10>
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_1a89e0f574920a18d4332ef8c51cb99a.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_1a89e0f574920a18d4332ef8c51cb99a.jpg saved to cache
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb36d0>
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_1b49e050999da1bc1c272de6824a8e5d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_1b49e050999da1bc1c272de6824a8e5d.jpg saved to cache
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_e9feb9ac8e0de9311723f34c263424ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_e9feb9ac8e0de9311723f34c263424ab.jpg not downloaded yet
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_557dc2ae6c621a4ac468b9dbc6b6f888.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_1bad12f254481b984ab4a5055685b230.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_2accdadda9c82b4378efe76d300dd9a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_032e679ff2ad58d5a8eb3b0a9e46510f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_a8e03466c3d4def81860128238d86ebe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_fe544950c98cf95486026f6d9748e96c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_c81774af966407b8d3b96bbd9598434b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_89386bd01a158b0b6f27c57b166658d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcbbe10>
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_557dc2ae6c621a4ac468b9dbc6b6f888.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_557dc2ae6c621a4ac468b9dbc6b6f888.jpg saved to cache
2026-03-28 18:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcd6750>
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_1bad12f254481b984ab4a5055685b230.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_1bad12f254481b984ab4a5055685b230.jpg saved to cache
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7f2d0>
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_2accdadda9c82b4378efe76d300dd9a1.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_2accdadda9c82b4378efe76d300dd9a1.jpg saved to cache
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb35590>
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_032e679ff2ad58d5a8eb3b0a9e46510f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_032e679ff2ad58d5a8eb3b0a9e46510f.jpg saved to cache
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda0810>
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_a8e03466c3d4def81860128238d86ebe.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_a8e03466c3d4def81860128238d86ebe.jpg saved to cache
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10f350>
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_fe544950c98cf95486026f6d9748e96c.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_fe544950c98cf95486026f6d9748e96c.jpg saved to cache
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb04090>
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_c81774af966407b8d3b96bbd9598434b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_c81774af966407b8d3b96bbd9598434b.jpg saved to cache
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb35890>
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fdf%252Fc8df68ab6b1ce7a543e9d3f63e95b892%252Fpa%252FKV17598_89386bd01a158b0b6f27c57b166658d9.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_89386bd01a158b0b6f27c57b166658d9.jpg saved to cache
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcdb427a-16cc-5853-abb5-e19121cdde3a
2026-03-28 18:38:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcdb427a-16cc-5853-abb5-e19121cdde3a, skipping ID generation
2026-03-28 18:38:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcdb427a-16cc-5853-abb5-e19121cdde3a with scrape type 1
2026-03-28 18:38:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcdb427a-16cc-5853-abb5-e19121cdde3a sending to next pipeline
2026-03-28 18:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcdb427a-16cc-5853-abb5-e19121cdde3a, identifier: KV17598
2026-03-28 18:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcdb427a-16cc-5853-abb5-e19121cdde3a with identifier: KV17598
2026-03-28 18:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcdb427a-16cc-5853-abb5-e19121cdde3a with identifier: KV17598
2026-03-28 18:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcdb427a-16cc-5853-abb5-e19121cdde3a with identifier: KV17598 to the API
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_89386bd01a158b0b6f27c57b166658d9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:17:25Z',
 'fuel_type': 'petrol',
 'id': 'fcdb427a-16cc-5853-abb5-e19121cdde3a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV17598',
 'listing': 'auction',
 'location': 'DE, Krefeld',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 69320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2688152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_032e679ff2ad58d5a8eb3b0a9e46510f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_b6a50b18f988c91f1133dbae7aa15f9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_557dc2ae6c621a4ac468b9dbc6b6f888.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69682,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_1b49e050999da1bc1c272de6824a8e5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_1a89e0f574920a18d4332ef8c51cb99a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_c2b4ba5fd08528cf5164cd01c75c0148.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2799540,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_fe544950c98cf95486026f6d9748e96c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2696958,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_a8e03466c3d4def81860128238d86ebe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_33bdc3eefc49f90413e8ab23f541bcd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcdb427a-16cc-5853-abb5-e19121cdde3a/fcdb427a-16cc-5853-abb5-e19121cdde3a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3108358,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/df/c8df68ab6b1ce7a543e9d3f63e95b892/pa/KV17598_89386bd01a158b0b6f27c57b166658d9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 MPI Soleil',
 'transmission': 'manual',
 'trim': 'Soleil',
 'year': 2019}
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV17598%27 HTTP/1.1" 200 None
2026-03-28 18:38:30 [auto1.de] INFO: Saving data for KV17598: {'created_time': 1774723110.620468, 'last_price_update_time': 1774723110.620479, 'auction_closing_time': 1774883845.0}
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV17598') HTTP/1.1" 204 0
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_dce0c86215b83d081d6e8ac28ff76aec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_7ee0aed38a26772b09fd43ad28666eb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_b727981b4cb96449e68951348f7603a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NZ79152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_bddb5ca5086d953d5a1e37c6f475edd3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_6463323f9c98d66fc084fa5b9370c23f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_4d83da2e8aa3b4cd1efaa73bdbb77c30.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_f9abc06dbbb3a922c18c12ff50851ea9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_88dd74839ec74ca8488123dd5121ad87.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd3750>
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_dce0c86215b83d081d6e8ac28ff76aec.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_dce0c86215b83d081d6e8ac28ff76aec.jpg saved to cache
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0e250>
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_7ee0aed38a26772b09fd43ad28666eb2.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_7ee0aed38a26772b09fd43ad28666eb2.jpg saved to cache
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdd8cd0>
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F17%252F361756eb6a11f50219f7b8e4bfad157d%252Fpa%252FUG29438_b727981b4cb96449e68951348f7603a4.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_b727981b4cb96449e68951348f7603a4.jpg saved to cache
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1
2026-03-28 18:38:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1, skipping ID generation
2026-03-28 18:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with scrape type 1
2026-03-28 18:38:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 sending to next pipeline
2026-03-28 18:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1, identifier: UG29438
2026-03-28 18:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d1c50>
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_bddb5ca5086d953d5a1e37c6f475edd3.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_bddb5ca5086d953d5a1e37c6f475edd3.jpg saved to cache
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d15d0>
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_6463323f9c98d66fc084fa5b9370c23f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_6463323f9c98d66fc084fa5b9370c23f.jpg saved to cache
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b215f50>
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_4d83da2e8aa3b4cd1efaa73bdbb77c30.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_4d83da2e8aa3b4cd1efaa73bdbb77c30.jpg saved to cache
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b1950>
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_f9abc06dbbb3a922c18c12ff50851ea9.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_f9abc06dbbb3a922c18c12ff50851ea9.jpg saved to cache
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb26d0>
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_88dd74839ec74ca8488123dd5121ad87.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_88dd74839ec74ca8488123dd5121ad87.jpg saved to cache
2026-03-28 18:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with identifier: UG29438
2026-03-28 18:38:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with identifier: UG29438
2026-03-28 18:38:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f819c8c-1d31-5467-8b47-fd3748c1d0e1 with identifier: UG29438 to the API
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_b727981b4cb96449e68951348f7603a4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:16:04Z',
 'fuel_type': 'petrol',
 'id': '8f819c8c-1d31-5467-8b47-fd3748c1d0e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG29438',
 'listing': 'auction',
 'location': 'DE, Münster',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 23402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_80cca09f8c1477f83db35c6a173db2a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_2c56e8763977028165557a22ca65d2fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_c4c5ea766b938b481170ec67879032ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_4a72b6393c6a57965e4a140775f4a7fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_7ee0aed38a26772b09fd43ad28666eb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_b727981b4cb96449e68951348f7603a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_dce0c86215b83d081d6e8ac28ff76aec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_2accdadda9c82b4378efe76d300dd9a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71003,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_1bad12f254481b984ab4a5055685b230.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f819c8c-1d31-5467-8b47-fd3748c1d0e1/8f819c8c-1d31-5467-8b47-fd3748c1d0e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3102817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/17/361756eb6a11f50219f7b8e4bfad157d/pa/UG29438_c81774af966407b8d3b96bbd9598434b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2011}
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG29438%27 HTTP/1.1" 200 None
2026-03-28 18:38:31 [auto1.de] INFO: Saving data for UG29438: {'created_time': 1774723111.92646, 'last_price_update_time': 1774723111.926471, 'auction_closing_time': 1774883764.0}
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG29438') HTTP/1.1" 204 0
2026-03-28 18:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_011b191f5278239ee28874752f4eaf71.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_e9feb9ac8e0de9311723f34c263424ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_8c9911b2ca9aef98efe1ed1fa1b2f7ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_639e3ff84e62b72dc1de176d6b60b58b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_d353be4e1a175db14fc50189f202be13.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_4969d34f1b8e08e7bbbde90c8d0cf3b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_0b8f6f564ecc68b163b8682608a061ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_e6c589b8dfbbccfcbce7a9f3d2bf2045.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd89f50>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_011b191f5278239ee28874752f4eaf71.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_011b191f5278239ee28874752f4eaf71.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b178690>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_e9feb9ac8e0de9311723f34c263424ab.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_e9feb9ac8e0de9311723f34c263424ab.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1045d0>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_8c9911b2ca9aef98efe1ed1fa1b2f7ea.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_8c9911b2ca9aef98efe1ed1fa1b2f7ea.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_653dc9b0528eafcc110b985cdfba1e7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_9d8836113903d650d4bf2eb3898b7537.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7fcd0>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_639e3ff84e62b72dc1de176d6b60b58b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_639e3ff84e62b72dc1de176d6b60b58b.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_677b13edc977d2238e9f282634bf3fbc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc4fc50>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_d353be4e1a175db14fc50189f202be13.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_d353be4e1a175db14fc50189f202be13.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd9a8d0>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_4969d34f1b8e08e7bbbde90c8d0cf3b8.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_4969d34f1b8e08e7bbbde90c8d0cf3b8.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2eead0>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_0b8f6f564ecc68b163b8682608a061ff.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_0b8f6f564ecc68b163b8682608a061ff.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd9abd0>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_e6c589b8dfbbccfcbce7a9f3d2bf2045.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_e6c589b8dfbbccfcbce7a9f3d2bf2045.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_a3bcade53153a58f253e19ed20f54269.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_9580e8209ae7d0a070f333229bc75bc7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beb0d10>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_653dc9b0528eafcc110b985cdfba1e7b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_653dc9b0528eafcc110b985cdfba1e7b.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb02650>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_9d8836113903d650d4bf2eb3898b7537.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_9d8836113903d650d4bf2eb3898b7537.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb67710>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_677b13edc977d2238e9f282634bf3fbc.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_677b13edc977d2238e9f282634bf3fbc.jpg saved to cache
2026-03-28 18:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d288d0>
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_a3bcade53153a58f253e19ed20f54269.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_a3bcade53153a58f253e19ed20f54269.jpg saved to cache
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d58f50>
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_9580e8209ae7d0a070f333229bc75bc7.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_9580e8209ae7d0a070f333229bc75bc7.jpg saved to cache
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_5919b78a4c6b0f706a3396ebc1f267f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ba6ab8d71b87fc05b8e7a2e64c925172.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_71f42c99ac7fdde12a64ee50d80bf11d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_1048420864b323ed1da93551e088ffa6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_eb2945ace07da3c525611c8d16945703.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_3bfa134858a21392d2e5c8515203f751.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_0875cb7c8d38852f4dc06f9175494e23.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_5897f5c8a1c65f9445eb19bf3dcac8f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_66e21341ad6ffda07c2d2e3d8b3b9c70.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_853c31d081dbcf139a8e8ec64e02009b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_6b58b927127ad6122c1049e88bada138.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b104150>
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_5919b78a4c6b0f706a3396ebc1f267f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_5919b78a4c6b0f706a3396ebc1f267f6.jpg saved to cache
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_e91a9bab1dc1cef203fa64b1fd0b1505.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb303d0>
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F1c%252F7c1c561b43a9ad0f2ea3df37dad0ed99%252Fpa%252FXR35811_ba6ab8d71b87fc05b8e7a2e64c925172.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ba6ab8d71b87fc05b8e7a2e64c925172.jpg saved to cache
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1689c499-9578-51a4-b130-15ce53373f03
2026-03-28 18:38:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1689c499-9578-51a4-b130-15ce53373f03, skipping ID generation
2026-03-28 18:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1689c499-9578-51a4-b130-15ce53373f03 with scrape type 1
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1689c499-9578-51a4-b130-15ce53373f03 sending to next pipeline
2026-03-28 18:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1689c499-9578-51a4-b130-15ce53373f03, identifier: XR35811
2026-03-28 18:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc8aa50>
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_71f42c99ac7fdde12a64ee50d80bf11d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_71f42c99ac7fdde12a64ee50d80bf11d.jpg saved to cache
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd59f10>
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_1048420864b323ed1da93551e088ffa6.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_1048420864b323ed1da93551e088ffa6.jpg saved to cache
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3f3d0>
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F5b%252F8a5b3cf1fe286ffa8f26ff0342c71c83%252Fpa%252FBG42804_eb2945ace07da3c525611c8d16945703.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_eb2945ace07da3c525611c8d16945703.jpg saved to cache
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 327845dc-8708-5969-b7b7-75cb2251fa87
2026-03-28 18:38:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 327845dc-8708-5969-b7b7-75cb2251fa87, skipping ID generation
2026-03-28 18:38:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327845dc-8708-5969-b7b7-75cb2251fa87 with scrape type 1
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 327845dc-8708-5969-b7b7-75cb2251fa87 sending to next pipeline
2026-03-28 18:38:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 327845dc-8708-5969-b7b7-75cb2251fa87, identifier: BG42804
2026-03-28 18:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda2610>
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_3bfa134858a21392d2e5c8515203f751.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_3bfa134858a21392d2e5c8515203f751.jpg saved to cache
2026-03-28 18:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bead9d0>
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fb4%252F0bb4873ea54d2aa7ec1597f5c3347460%252Fpa%252FCW85183_0875cb7c8d38852f4dc06f9175494e23.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_0875cb7c8d38852f4dc06f9175494e23.jpg saved to cache
2026-03-28 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6712172-10f3-5907-b451-656f07af9e82
2026-03-28 18:38:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6712172-10f3-5907-b451-656f07af9e82, skipping ID generation
2026-03-28 18:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6712172-10f3-5907-b451-656f07af9e82 with scrape type 1
2026-03-28 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6712172-10f3-5907-b451-656f07af9e82 sending to next pipeline
2026-03-28 18:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6712172-10f3-5907-b451-656f07af9e82, identifier: CW85183
2026-03-28 18:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd81d90>
2026-03-28 18:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_5897f5c8a1c65f9445eb19bf3dcac8f0.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_5897f5c8a1c65f9445eb19bf3dcac8f0.jpg saved to cache
2026-03-28 18:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1689c499-9578-51a4-b130-15ce53373f03 with identifier: XR35811
2026-03-28 18:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1689c499-9578-51a4-b130-15ce53373f03 with identifier: XR35811
2026-03-28 18:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1689c499-9578-51a4-b130-15ce53373f03 with identifier: XR35811 to the API
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ba6ab8d71b87fc05b8e7a2e64c925172.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:38:40Z',
 'fuel_type': 'petrol',
 'id': '1689c499-9578-51a4-b130-15ce53373f03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR35811',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 160267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ba6ab8d71b87fc05b8e7a2e64c925172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_a3bcade53153a58f253e19ed20f54269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_eba9fea970e174b8e9cd1d2304607690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_ef9932c527f9390b8a32682f1b0ef20d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_32d546c369c5d55f2c3d4d26e30228e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2928987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_f30bbc77dd478f42ac3712e74fc73883.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_abbe8dcae4ccc85851642fa8af13d4c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_a4b7c5b2d8c3b6a26f2645c1f2509d04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_659f83c8b677b8778a7434e254238088.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1689c499-9578-51a4-b130-15ce53373f03/1689c499-9578-51a4-b130-15ce53373f03_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/1c/7c1c561b43a9ad0f2ea3df37dad0ed99/pa/XR35811_3265991c1e91b107f92332e64f84fc6f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'automatic',
 'trim': 'Team',
 'year': 2011}
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR35811%27 HTTP/1.1" 200 None
2026-03-28 18:38:34 [auto1.de] INFO: Saving data for XR35811: {'created_time': 1774723114.581556, 'last_price_update_time': 1774723114.581568, 'auction_closing_time': 1774885120.0}
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR35811') HTTP/1.1" 204 0
2026-03-28 18:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 327845dc-8708-5969-b7b7-75cb2251fa87 with identifier: BG42804
2026-03-28 18:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 327845dc-8708-5969-b7b7-75cb2251fa87 with identifier: BG42804
2026-03-28 18:38:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 327845dc-8708-5969-b7b7-75cb2251fa87 with identifier: BG42804 to the API
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_eb2945ace07da3c525611c8d16945703.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:34:37Z',
 'fuel_type': 'hybrid',
 'id': '327845dc-8708-5969-b7b7-75cb2251fa87',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG42804',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 140087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2558169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_1048420864b323ed1da93551e088ffa6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2509016,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_eb2945ace07da3c525611c8d16945703.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_677b13edc977d2238e9f282634bf3fbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2314816,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_88dd74839ec74ca8488123dd5121ad87.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_653dc9b0528eafcc110b985cdfba1e7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_0b8f6f564ecc68b163b8682608a061ff.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2177174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_d353be4e1a175db14fc50189f202be13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_8c9911b2ca9aef98efe1ed1fa1b2f7ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2448526,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_bddb5ca5086d953d5a1e37c6f475edd3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_327845dc-8708-5969-b7b7-75cb2251fa87/327845dc-8708-5969-b7b7-75cb2251fa87_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/5b/8a5b3cf1fe286ffa8f26ff0342c71c83/pa/BG42804_e9feb9ac8e0de9311723f34c263424ab.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Team D',
 'transmission': 'automatic',
 'trim': 'Team D',
 'year': 2022}
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG42804%27 HTTP/1.1" 200 None
2026-03-28 18:38:34 [auto1.de] INFO: Saving data for BG42804: {'created_time': 1774723114.979672, 'last_price_update_time': 1774723114.979684, 'auction_closing_time': 1774884877.0}
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG42804') HTTP/1.1" 204 0
2026-03-28 18:38:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6712172-10f3-5907-b451-656f07af9e82 with identifier: CW85183
2026-03-28 18:38:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6712172-10f3-5907-b451-656f07af9e82 with identifier: CW85183
2026-03-28 18:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6712172-10f3-5907-b451-656f07af9e82 with identifier: CW85183 to the API
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_0875cb7c8d38852f4dc06f9175494e23.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:05Z',
 'fuel_type': 'diesel',
 'id': 'd6712172-10f3-5907-b451-656f07af9e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW85183',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 207154,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2901140,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_0875cb7c8d38852f4dc06f9175494e23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2819002,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_3bfa134858a21392d2e5c8515203f751.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2006833,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_71f42c99ac7fdde12a64ee50d80bf11d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_9d8836113903d650d4bf2eb3898b7537.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1950801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_6463323f9c98d66fc084fa5b9370c23f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2036989,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_4d83da2e8aa3b4cd1efaa73bdbb77c30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1994464,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_639e3ff84e62b72dc1de176d6b60b58b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2296926,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_4969d34f1b8e08e7bbbde90c8d0cf3b8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2720503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_e6c589b8dfbbccfcbce7a9f3d2bf2045.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6712172-10f3-5907-b451-656f07af9e82/d6712172-10f3-5907-b451-656f07af9e82_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/b4/0bb4873ea54d2aa7ec1597f5c3347460/pa/CW85183_011b191f5278239ee28874752f4eaf71.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW85183%27 HTTP/1.1" 200 None
2026-03-28 18:38:35 [auto1.de] INFO: Saving data for CW85183: {'created_time': 1774723115.379515, 'last_price_update_time': 1774723115.379527, 'auction_closing_time': 1774886165.0}
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW85183') HTTP/1.1" 204 0
2026-03-28 18:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH18669> (referer: https://www.auto1.com/v1/car-details-view/YH18669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD40697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KA54911> (referer: https://www.auto1.com/v1/car-details-view/KA54911/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH84481/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY30954/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL46038> (referer: https://www.auto1.com/v1/car-details-view/FL46038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc99950>
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_66e21341ad6ffda07c2d2e3d8b3b9c70.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_66e21341ad6ffda07c2d2e3d8b3b9c70.jpg saved to cache
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1ce10>
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_853c31d081dbcf139a8e8ec64e02009b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_853c31d081dbcf139a8e8ec64e02009b.jpg saved to cache
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5535f39-5b58-5ca5-b54d-1085d87996f6
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ceb710>
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_6b58b927127ad6122c1049e88bada138.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_6b58b927127ad6122c1049e88bada138.jpg saved to cache
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5535f39-5b58-5ca5-b54d-1085d87996f6
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1de10>
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9f%252Fe7%252F9fe71610a6d5f7a1eebd7af1e0fbf409%252Fpa%252FRF12873_e91a9bab1dc1cef203fa64b1fd0b1505.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_e91a9bab1dc1cef203fa64b1fd0b1505.jpg saved to cache
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2de83903-3e01-55d4-ae21-eb41d0d128cb
2026-03-28 18:38:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2de83903-3e01-55d4-ae21-eb41d0d128cb, skipping ID generation
2026-03-28 18:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2de83903-3e01-55d4-ae21-eb41d0d128cb with scrape type 1
2026-03-28 18:38:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2de83903-3e01-55d4-ae21-eb41d0d128cb sending to next pipeline
2026-03-28 18:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2de83903-3e01-55d4-ae21-eb41d0d128cb, identifier: RF12873
2026-03-28 18:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2de83903-3e01-55d4-ae21-eb41d0d128cb with identifier: RF12873
2026-03-28 18:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2de83903-3e01-55d4-ae21-eb41d0d128cb with identifier: RF12873
2026-03-28 18:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2de83903-3e01-55d4-ae21-eb41d0d128cb with identifier: RF12873 to the API
2026-03-28 18:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_e91a9bab1dc1cef203fa64b1fd0b1505.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:57Z',
 'fuel_type': 'diesel',
 'id': '2de83903-3e01-55d4-ae21-eb41d0d128cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF12873',
 'listing': 'auction',
 'location': 'DE, Zweibrücken',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 296972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_5919b78a4c6b0f706a3396ebc1f267f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_e91a9bab1dc1cef203fa64b1fd0b1505.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77157,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_9580e8209ae7d0a070f333229bc75bc7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2251021,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_f9abc06dbbb3a922c18c12ff50851ea9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_13896d92cbe9d44af08e25be4c0ef062.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_434a46270960bcbf9005b1c995c18b60.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2309983,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_18f6dcefaadea460c010a4adf358e2d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_8ea48cffdd5900da8b14687ed4dcc4cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76558,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_8636ffc92059921abbe123b94dd38915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2de83903-3e01-55d4-ae21-eb41d0d128cb/2de83903-3e01-55d4-ae21-eb41d0d128cb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9f/e7/9fe71610a6d5f7a1eebd7af1e0fbf409/pa/RF12873_fad4599a8ff0d901521994c47b2fd588.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2012}
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF12873%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [auto1.de] INFO: Saving data for RF12873: {'created_time': 1774723116.127225, 'last_price_update_time': 1774723116.127238, 'auction_closing_time': 1774883097.0}
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF12873') HTTP/1.1" 204 0
2026-03-28 18:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with identifier: YH18669
2026-03-28 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with scrape type 1
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_be89a8696ed961d4450e20fe3f6c89f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_be89a8696ed961d4450e20fe3f6c89f2.jpg not downloaded yet
2026-03-28 18:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d897b9bb-8551-5964-9ce8-4570df9c55fa with identifier: KA54911
2026-03-28 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d897b9bb-8551-5964-9ce8-4570df9c55fa with scrape type 1
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d897b9bb-8551-5964-9ce8-4570df9c55fa
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_e62662df02360fa0615e8cda14d9c516.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_e62662df02360fa0615e8cda14d9c516.jpg not downloaded yet
2026-03-28 18:38:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with identifier: FL46038
2026-03-28 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with scrape type 1
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_fbe777d550c41e32b7f2e83587d76a47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_fbe777d550c41e32b7f2e83587d76a47.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_275d319bc0c31035a845b2b4f86bf215.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_275d319bc0c31035a845b2b4f86bf215.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_48043670eec5203ad917d3c75b953e90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_48043670eec5203ad917d3c75b953e90.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_f0684602dcbae9f729f39c6b982db07d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_f0684602dcbae9f729f39c6b982db07d.jpg not downloaded yet
2026-03-28 18:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_0d03f317845d03affcf400e33afc5570.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_1e67a18cbb9643553776557d45d78a75.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_9ffa42eeed9b9f474df3b3114d0ad503.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_60c410c2b4e097fab6b6d565813b7c4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_60c410c2b4e097fab6b6d565813b7c4d.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_d216c8f979aca3cd4fd4d4fc6d1a3951.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_d216c8f979aca3cd4fd4d4fc6d1a3951.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_3d7de0ab6dedf36b68cc3cb71544b90b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_3d7de0ab6dedf36b68cc3cb71544b90b.jpg not downloaded yet
2026-03-28 18:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_c4643ede3837449d74aae5f297d7309a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_05c9b6f7ceab98464b38ed4488a8e1d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_05c9b6f7ceab98464b38ed4488a8e1d0.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_2757a0142e3937c968447d107651f3b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_2757a0142e3937c968447d107651f3b7.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_9eaedeec7acb0637b6b8c5089231c904.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_9eaedeec7acb0637b6b8c5089231c904.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_422c126e3ddbda5254b4606d4559d6f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_422c126e3ddbda5254b4606d4559d6f2.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_dd4ab76783804bc77aa3c699bd9b5e03.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_dd4ab76783804bc77aa3c699bd9b5e03.jpg not downloaded yet
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_06ed7a71780426c024f766a2c4b5def3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_06ed7a71780426c024f766a2c4b5def3.jpg not downloaded yet
2026-03-28 18:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_988af3c84ca4657766481d2cbf782e38.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_275d319bc0c31035a845b2b4f86bf215.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_be98c8f4697988bcfcf341d5ca3ad0d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_be98c8f4697988bcfcf341d5ca3ad0d8.jpg not downloaded yet
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3e050>
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_0d03f317845d03affcf400e33afc5570.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_0d03f317845d03affcf400e33afc5570.jpg saved to cache
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7fad0>
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_1e67a18cbb9643553776557d45d78a75.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_1e67a18cbb9643553776557d45d78a75.jpg saved to cache
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5535f39-5b58-5ca5-b54d-1085d87996f6
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbdb2d0>
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd8%252Fb0%252Fd8b0cd11b2ba00f1a610b571b63b1b56%252Fpa%252FUV09635_9ffa42eeed9b9f474df3b3114d0ad503.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_9ffa42eeed9b9f474df3b3114d0ad503.jpg saved to cache
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5535f39-5b58-5ca5-b54d-1085d87996f6
2026-03-28 18:38:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5535f39-5b58-5ca5-b54d-1085d87996f6, skipping ID generation
2026-03-28 18:38:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5535f39-5b58-5ca5-b54d-1085d87996f6 with scrape type 1
2026-03-28 18:38:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5535f39-5b58-5ca5-b54d-1085d87996f6 sending to next pipeline
2026-03-28 18:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5535f39-5b58-5ca5-b54d-1085d87996f6, identifier: UV09635
2026-03-28 18:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5535f39-5b58-5ca5-b54d-1085d87996f6 with identifier: UV09635
2026-03-28 18:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5535f39-5b58-5ca5-b54d-1085d87996f6 with identifier: UV09635
2026-03-28 18:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5535f39-5b58-5ca5-b54d-1085d87996f6 with identifier: UV09635 to the API
2026-03-28 18:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_9ffa42eeed9b9f474df3b3114d0ad503.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:46:01Z',
 'fuel_type': 'petrol',
 'id': 'b5535f39-5b58-5ca5-b54d-1085d87996f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV09635',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 133775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_9ffa42eeed9b9f474df3b3114d0ad503.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_1e67a18cbb9643553776557d45d78a75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75173,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_6b58b927127ad6122c1049e88bada138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_853c31d081dbcf139a8e8ec64e02009b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_4bf40482805158e3a246c01cdd9443d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5535f39-5b58-5ca5-b54d-1085d87996f6/b5535f39-5b58-5ca5-b54d-1085d87996f6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd8/b0/d8b0cd11b2ba00f1a610b571b63b1b56/pa/UV09635_a5b20db8020a8a59900f4ce67e552c4f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Comfort Blue',
 'transmission': 'manual',
 'trim': 'Comfort Blue',
 'year': 2009}
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV09635%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [auto1.de] INFO: Saving data for UV09635: {'created_time': 1774723117.155192, 'last_price_update_time': 1774723117.155209, 'auction_closing_time': 1774885561.0}
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV09635') HTTP/1.1" 204 0
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_f0684602dcbae9f729f39c6b982db07d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_e408bf49364ddc10c49d145350b5071a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_e408bf49364ddc10c49d145350b5071a.jpg not downloaded yet
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_3d7de0ab6dedf36b68cc3cb71544b90b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_48043670eec5203ad917d3c75b953e90.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8d950>
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_c4643ede3837449d74aae5f297d7309a.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_c4643ede3837449d74aae5f297d7309a.jpg saved to cache
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 44e36140-202a-52aa-bbc8-7287ce5f94bc
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be789d0>
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge2%252F90%252Fe29096bc3bd91aacc3fe76647f246768%252Fpa%252FEE75447_988af3c84ca4657766481d2cbf782e38.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_988af3c84ca4657766481d2cbf782e38.jpg saved to cache
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 44e36140-202a-52aa-bbc8-7287ce5f94bc
2026-03-28 18:38:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 44e36140-202a-52aa-bbc8-7287ce5f94bc, skipping ID generation
2026-03-28 18:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44e36140-202a-52aa-bbc8-7287ce5f94bc with scrape type 1
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 44e36140-202a-52aa-bbc8-7287ce5f94bc sending to next pipeline
2026-03-28 18:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44e36140-202a-52aa-bbc8-7287ce5f94bc, identifier: EE75447
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bebced0>
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_275d319bc0c31035a845b2b4f86bf215.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_275d319bc0c31035a845b2b4f86bf215.jpg saved to cache
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_8dac24721130b8c3726998a49944c6d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_8dac24721130b8c3726998a49944c6d7.jpg not downloaded yet
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR83992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ18953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MX21840/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR45963/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU44008> (referer: https://www.auto1.com/v1/car-details-view/AU44008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44e36140-202a-52aa-bbc8-7287ce5f94bc with identifier: EE75447
2026-03-28 18:38:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44e36140-202a-52aa-bbc8-7287ce5f94bc with identifier: EE75447
2026-03-28 18:38:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44e36140-202a-52aa-bbc8-7287ce5f94bc with identifier: EE75447 to the API
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_988af3c84ca4657766481d2cbf782e38.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 2',
 'engine': '1.8L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:34:02Z',
 'fuel_type': 'petrol',
 'id': '44e36140-202a-52aa-bbc8-7287ce5f94bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE75447',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Peugeot',
 'model': '306',
 'odometer': 122226,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_6fa6f0d3915069b8d5d8114e6ece71f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_5f3d50dac99c35f54c5582ff8f9a911b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_988af3c84ca4657766481d2cbf782e38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_c4643ede3837449d74aae5f297d7309a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_44e36140-202a-52aa-bbc8-7287ce5f94bc/44e36140-202a-52aa-bbc8-7287ce5f94bc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 129727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge2/90/e29096bc3bd91aacc3fe76647f246768/pa/EE75447_429485c33d415c34ebdbf17310aefa2c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1997-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 306 1.8 XR',
 'transmission': 'automatic',
 'trim': 'XR',
 'year': 1997}
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE75447%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [auto1.de] INFO: Saving data for EE75447: {'created_time': 1774723117.775918, 'last_price_update_time': 1774723117.77593, 'auction_closing_time': 1774884842.0}
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE75447') HTTP/1.1" 204 0
2026-03-28 18:38:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_dd4ab76783804bc77aa3c699bd9b5e03.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_1970dbb4320b7733d5dd7a28a53f830f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_1970dbb4320b7733d5dd7a28a53f830f.jpg not downloaded yet
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK26673> (referer: https://www.auto1.com/v1/car-details-view/NK26673/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RW68722/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdbe250>
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_f0684602dcbae9f729f39c6b982db07d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_f0684602dcbae9f729f39c6b982db07d.jpg saved to cache
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcfd9d0>
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_3d7de0ab6dedf36b68cc3cb71544b90b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_3d7de0ab6dedf36b68cc3cb71544b90b.jpg saved to cache
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd4150>
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_48043670eec5203ad917d3c75b953e90.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_48043670eec5203ad917d3c75b953e90.jpg saved to cache
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d897b9bb-8551-5964-9ce8-4570df9c55fa
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_6dedb9b4c690910e6e2a002f8d203086.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_6dedb9b4c690910e6e2a002f8d203086.jpg not downloaded yet
2026-03-28 18:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with identifier: AU44008
2026-03-28 18:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with scrape type 1
2026-03-28 18:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_e6e0aa86a03f1e8a5edc1f000334e6ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_e6e0aa86a03f1e8a5edc1f000334e6ad.jpg not downloaded yet
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_422c126e3ddbda5254b4606d4559d6f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_9eaedeec7acb0637b6b8c5089231c904.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_1e5a871c5cab3599065515b5f3cc8b67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_1e5a871c5cab3599065515b5f3cc8b67.jpg not downloaded yet
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_e408bf49364ddc10c49d145350b5071a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_2757a0142e3937c968447d107651f3b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcff050>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_dd4ab76783804bc77aa3c699bd9b5e03.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_dd4ab76783804bc77aa3c699bd9b5e03.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d897b9bb-8551-5964-9ce8-4570df9c55fa
2026-03-28 18:38:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea551c45-0267-5902-b613-7e226bab0a90 with identifier: NK26673
2026-03-28 18:38:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea551c45-0267-5902-b613-7e226bab0a90 with scrape type 1
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_fc3a8d56e886eee562dbdfc60dbe34f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_fc3a8d56e886eee562dbdfc60dbe34f7.jpg not downloaded yet
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_9ad6ecec4c6a39f9535ba20c50c2124f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_9ad6ecec4c6a39f9535ba20c50c2124f.jpg not downloaded yet
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_79fd95ecc376a8d5c3bedfb830a54d08.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_79fd95ecc376a8d5c3bedfb830a54d08.jpg not downloaded yet
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_05c9b6f7ceab98464b38ed4488a8e1d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_ae1467efb90d770b900dc219da4e2c16.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_ae1467efb90d770b900dc219da4e2c16.jpg not downloaded yet
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_678e52ae2dedcd69e9bd9eacb4663852.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_678e52ae2dedcd69e9bd9eacb4663852.jpg not downloaded yet
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_60c410c2b4e097fab6b6d565813b7c4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_9d5a3be31da48620bfaa7e1cfae2714d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_9d5a3be31da48620bfaa7e1cfae2714d.jpg not downloaded yet
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb096d0>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_422c126e3ddbda5254b4606d4559d6f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_422c126e3ddbda5254b4606d4559d6f2.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb302d0>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_9eaedeec7acb0637b6b8c5089231c904.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_9eaedeec7acb0637b6b8c5089231c904.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b22f0d0>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_e408bf49364ddc10c49d145350b5071a.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_e408bf49364ddc10c49d145350b5071a.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b297650>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_2757a0142e3937c968447d107651f3b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_2757a0142e3937c968447d107651f3b7.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d897b9bb-8551-5964-9ce8-4570df9c55fa
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_2cbabe17d84f450dcd94c2f8ac821b49.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_2cbabe17d84f450dcd94c2f8ac821b49.jpg not downloaded yet
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_d216c8f979aca3cd4fd4d4fc6d1a3951.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_ca3ae1ceff51da808a87aeed45fc34eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_ca3ae1ceff51da808a87aeed45fc34eb.jpg not downloaded yet
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_1970dbb4320b7733d5dd7a28a53f830f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_d7c3e16fd70d2a3f62ef2ba4ae314fe7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_d7c3e16fd70d2a3f62ef2ba4ae314fe7.jpg not downloaded yet
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd68250>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_05c9b6f7ceab98464b38ed4488a8e1d0.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_05c9b6f7ceab98464b38ed4488a8e1d0.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d16950>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_60c410c2b4e097fab6b6d565813b7c4d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_60c410c2b4e097fab6b6d565813b7c4d.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_18f4753b4623b80f20e6af8ef6960a1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_fbe777d550c41e32b7f2e83587d76a47.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_3a37003eb8437edffbf56637ee518e34.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_3a37003eb8437edffbf56637ee518e34.jpg not downloaded yet
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_ad90c0df30f3662f2497548b8d9f60ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_ad90c0df30f3662f2497548b8d9f60ad.jpg not downloaded yet
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_94c237bcf4ef20771295d3c8c66548a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_94c237bcf4ef20771295d3c8c66548a8.jpg not downloaded yet
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2f80d0>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_d216c8f979aca3cd4fd4d4fc6d1a3951.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_d216c8f979aca3cd4fd4d4fc6d1a3951.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d897b9bb-8551-5964-9ce8-4570df9c55fa
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb965d0>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_1970dbb4320b7733d5dd7a28a53f830f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_1970dbb4320b7733d5dd7a28a53f830f.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_14ee9fc87b94b2cceadec9d5ccd52c17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_14ee9fc87b94b2cceadec9d5ccd52c17.jpg not downloaded yet
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_ae1467efb90d770b900dc219da4e2c16.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_9ad6ecec4c6a39f9535ba20c50c2124f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_e6e0aa86a03f1e8a5edc1f000334e6ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_d89d69eb25e68a76218840f4fcb6eb6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_d89d69eb25e68a76218840f4fcb6eb6b.jpg not downloaded yet
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_0b3746df58fe83de8fdbc1f7c1ab85d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_0b3746df58fe83de8fdbc1f7c1ab85d7.jpg not downloaded yet
2026-03-28 18:38:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbf9690>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_18f4753b4623b80f20e6af8ef6960a1a.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_18f4753b4623b80f20e6af8ef6960a1a.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be73b50>
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_fbe777d550c41e32b7f2e83587d76a47.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_fbe777d550c41e32b7f2e83587d76a47.jpg saved to cache
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_6005d2461745eca2d9e5bcf1d3822f9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_6005d2461745eca2d9e5bcf1d3822f9d.jpg not downloaded yet
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_9a9df8b1e8476746567a58a5548e623c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_9a9df8b1e8476746567a58a5548e623c.jpg not downloaded yet
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_2cbabe17d84f450dcd94c2f8ac821b49.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd4f010>
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_ae1467efb90d770b900dc219da4e2c16.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_ae1467efb90d770b900dc219da4e2c16.jpg saved to cache
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcfc090>
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_9ad6ecec4c6a39f9535ba20c50c2124f.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_9ad6ecec4c6a39f9535ba20c50c2124f.jpg saved to cache
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bead250>
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_e6e0aa86a03f1e8a5edc1f000334e6ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_e6e0aa86a03f1e8a5edc1f000334e6ad.jpg saved to cache
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_ca3ae1ceff51da808a87aeed45fc34eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_9d5a3be31da48620bfaa7e1cfae2714d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_0c7bc642e570d431c82f625843c8d574.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_0c7bc642e570d431c82f625843c8d574.jpg not downloaded yet
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb9df10>
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_2cbabe17d84f450dcd94c2f8ac821b49.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_2cbabe17d84f450dcd94c2f8ac821b49.jpg saved to cache
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:39 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_94c237bcf4ef20771295d3c8c66548a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-28 18:38:39 [auto1.de] INFO: Scrape type for TP61394: 1
2026-03-28 18:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_b86301c6d26c9e7edc1305e6b3f5d82e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_678e52ae2dedcd69e9bd9eacb4663852.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-28 18:38:39 [auto1.de] INFO: Scrape type for BU21003: 1
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_ad90c0df30f3662f2497548b8d9f60ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-28 18:38:39 [auto1.de] INFO: Scrape type for CG91765: 2
2026-03-28 18:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d905bba-22c8-5505-b1d9-def83f87b672 with identifier: CG91765
2026-03-28 18:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d905bba-22c8-5505-b1d9-def83f87b672 with scrape type 2
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d905bba-22c8-5505-b1d9-def83f87b672 with scrape type 2
2026-03-28 18:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d905bba-22c8-5505-b1d9-def83f87b672, identifier: CG91765
2026-03-28 18:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d905bba-22c8-5505-b1d9-def83f87b672 with identifier: CG91765
2026-03-28 18:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d905bba-22c8-5505-b1d9-def83f87b672 with identifier: CG91765
2026-03-28 18:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d905bba-22c8-5505-b1d9-def83f87b672 with identifier: CG91765 to the API
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:37:16Z',
 'fuel_type': 'petrol',
 'id': '0d905bba-22c8-5505-b1d9-def83f87b672',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG91765',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 77814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-23',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Petit Filou',
 'transmission': 'manual',
 'trim': 'Petit Filou',
 'year': 2009}
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG91765%27 HTTP/1.1" 200 None
2026-03-28 18:38:39 [auto1.de] INFO: Saving data for CG91765: {'auction_closing_time': 1774885036.0, 'created_time': 1774118522.878795, 'last_price_update_time': 1774723119.853319}
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG91765') HTTP/1.1" 204 0
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6efd0>
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_ca3ae1ceff51da808a87aeed45fc34eb.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_ca3ae1ceff51da808a87aeed45fc34eb.jpg saved to cache
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be710d0>
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_9d5a3be31da48620bfaa7e1cfae2714d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_9d5a3be31da48620bfaa7e1cfae2714d.jpg saved to cache
2026-03-28 18:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_d89d69eb25e68a76218840f4fcb6eb6b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-28 18:38:39 [auto1.de] INFO: Scrape type for NG66001: 1
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_6005d2461745eca2d9e5bcf1d3822f9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_14ee9fc87b94b2cceadec9d5ccd52c17.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_9a9df8b1e8476746567a58a5548e623c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_0b3746df58fe83de8fdbc1f7c1ab85d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY30954> (referer: https://www.auto1.com/v1/car-details-view/NY30954/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH84481> (referer: https://www.auto1.com/v1/car-details-view/HH84481/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR45963> (referer: https://www.auto1.com/v1/car-details-view/DR45963/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbbd350>
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_94c237bcf4ef20771295d3c8c66548a8.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_94c237bcf4ef20771295d3c8c66548a8.jpg saved to cache
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb94d10>
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfa%252F9e%252Ffa9e5683dfb5a2fe98a75c3330cdeee9%252Fpa%252FMY94359_b86301c6d26c9e7edc1305e6b3f5d82e.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_b86301c6d26c9e7edc1305e6b3f5d82e.jpg saved to cache
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea
2026-03-28 18:38:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cd6a9bb-9bc7-5717-8c44-5651965042ea, skipping ID generation
2026-03-28 18:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea with scrape type 1
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cd6a9bb-9bc7-5717-8c44-5651965042ea sending to next pipeline
2026-03-28 18:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cd6a9bb-9bc7-5717-8c44-5651965042ea, identifier: MY94359
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf3b50>
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_678e52ae2dedcd69e9bd9eacb4663852.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_678e52ae2dedcd69e9bd9eacb4663852.jpg saved to cache
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b288790>
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_ad90c0df30f3662f2497548b8d9f60ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_ad90c0df30f3662f2497548b8d9f60ad.jpg saved to cache
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:40 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-28 18:38:40 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-28 18:38:40 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-28 18:38:40 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-28 18:38:40 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-28 18:38:40 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-28 18:38:40 [auto1.de] INFO: Scrape type for EA38947: 2
2026-03-28 18:38:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0552dc28-1ee6-5899-832e-c71d069227bd with identifier: EA38947
2026-03-28 18:38:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0552dc28-1ee6-5899-832e-c71d069227bd with scrape type 2
2026-03-28 18:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0552dc28-1ee6-5899-832e-c71d069227bd with scrape type 2
2026-03-28 18:38:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0552dc28-1ee6-5899-832e-c71d069227bd, identifier: EA38947
2026-03-28 18:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cd6a9bb-9bc7-5717-8c44-5651965042ea with identifier: MY94359
2026-03-28 18:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cd6a9bb-9bc7-5717-8c44-5651965042ea with identifier: MY94359
2026-03-28 18:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cd6a9bb-9bc7-5717-8c44-5651965042ea with identifier: MY94359 to the API
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_b86301c6d26c9e7edc1305e6b3f5d82e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:18Z',
 'fuel_type': 'diesel',
 'id': '6cd6a9bb-9bc7-5717-8c44-5651965042ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY94359',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 161827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_0d03f317845d03affcf400e33afc5570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2856244,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_b86301c6d26c9e7edc1305e6b3f5d82e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2801634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_18f4753b4623b80f20e6af8ef6960a1a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_f14de84b55a0b568918c255967c6be61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3102802,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_eb4f9a1b9836c1b14b448499c3af9f66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2994858,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_60e3b88ae7187aed62502699f82852d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_2371f9e94ed2401f94faad6405cda425.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_66e21341ad6ffda07c2d2e3d8b3b9c70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_08e3810224322622c5344b9329c9fb90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6cd6a9bb-9bc7-5717-8c44-5651965042ea/6cd6a9bb-9bc7-5717-8c44-5651965042ea_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84097,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfa/9e/fa9e5683dfb5a2fe98a75c3330cdeee9/pa/MY94359_5897f5c8a1c65f9445eb19bf3dcac8f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Alltrack BlueMotion 4Motion',
 'transmission': 'automatic',
 'trim': 'Alltrack BlueMotion 4Motion',
 'year': 2019}
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY94359%27 HTTP/1.1" 200 None
2026-03-28 18:38:40 [auto1.de] INFO: Saving data for MY94359: {'created_time': 1774723120.8107, 'last_price_update_time': 1774723120.810711, 'auction_closing_time': 1774884198.0}
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY94359') HTTP/1.1" 204 0
2026-03-28 18:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_06ed7a71780426c024f766a2c4b5def3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0552dc28-1ee6-5899-832e-c71d069227bd with identifier: EA38947
2026-03-28 18:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0552dc28-1ee6-5899-832e-c71d069227bd with identifier: EA38947
2026-03-28 18:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0552dc28-1ee6-5899-832e-c71d069227bd with identifier: EA38947 to the API
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:31:01Z',
 'fuel_type': 'diesel',
 'id': '0552dc28-1ee6-5899-832e-c71d069227bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA38947',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 135120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-11',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 CRDi Edition 7 2WD',
 'transmission': 'manual',
 'trim': 'Edition 7 2WD',
 'year': 2015}
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA38947%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [auto1.de] INFO: Saving data for EA38947: {'auction_closing_time': 1774884661.0, 'created_time': 1774349279.628415, 'last_price_update_time': 1774723121.256129}
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA38947') HTTP/1.1" 204 0
2026-03-28 18:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_3a37003eb8437edffbf56637ee518e34.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:41 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-28 18:38:41 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-28 18:38:41 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-28 18:38:41 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [auto1.de] INFO: Scrape type for HZ69536: 1
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd82210>
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_d89d69eb25e68a76218840f4fcb6eb6b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_d89d69eb25e68a76218840f4fcb6eb6b.jpg saved to cache
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda8890>
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_6005d2461745eca2d9e5bcf1d3822f9d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_6005d2461745eca2d9e5bcf1d3822f9d.jpg saved to cache
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcfd3d0>
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_14ee9fc87b94b2cceadec9d5ccd52c17.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_14ee9fc87b94b2cceadec9d5ccd52c17.jpg saved to cache
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8eb50>
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_9a9df8b1e8476746567a58a5548e623c.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_9a9df8b1e8476746567a58a5548e623c.jpg saved to cache
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10c590>
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_0b3746df58fe83de8fdbc1f7c1ab85d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_0b3746df58fe83de8fdbc1f7c1ab85d7.jpg saved to cache
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with identifier: NY30954
2026-03-28 18:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with scrape type 1
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfe25d2f-e968-5447-a2bd-ce1d0dc23b05
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_11a7e7b2e73679453baf39496f3c8357.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_11a7e7b2e73679453baf39496f3c8357.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_02b5575cb42a6a03f5e8e908168dff97.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_02b5575cb42a6a03f5e8e908168dff97.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_2c8d408cfe57c05dd407567b13452535.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_2c8d408cfe57c05dd407567b13452535.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_59c3af4348da61ad496ef51abda094aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_59c3af4348da61ad496ef51abda094aa.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_67e0b1e524f3e5ceb4c81c445c66dec3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_67e0b1e524f3e5ceb4c81c445c66dec3.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_3ff8a0182f2b2b6cc7c7a0f6c1823d5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_3ff8a0182f2b2b6cc7c7a0f6c1823d5e.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_bf00b692918c30ef386f08f6e3cb68ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_bf00b692918c30ef386f08f6e3cb68ee.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_fa78196cccf97b4d7b6b42ec27aa2a9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_fa78196cccf97b4d7b6b42ec27aa2a9c.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_24168ee0daada83f44c4feacf64e1995.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_24168ee0daada83f44c4feacf64e1995.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F5e%252F7c5e2d4adb6234b34e8b32dc81cb3025%252Fpa%252FNY30954_9d3325171794ae0d4a13bade3f139230.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_9d3325171794ae0d4a13bade3f139230.jpg already downloaded
2026-03-28 18:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05, identifier: NY30954
2026-03-28 18:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 918d6851-986f-5c47-9508-5d77ea02efee with identifier: HH84481
2026-03-28 18:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 918d6851-986f-5c47-9508-5d77ea02efee with scrape type 1
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_5832a7b282860fea05c824772458a2b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_5832a7b282860fea05c824772458a2b2.jpg not downloaded yet
2026-03-28 18:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with identifier: DR45963
2026-03-28 18:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with scrape type 1
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7ec509d3-cc6b-526d-a90c-7cbc0c665212
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fb3%252Fe8b374004fce63d50df73dcb5e314091%252Fpa%252FDR45963_7f432466afb943f4c1a5c0996077a262.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_7f432466afb943f4c1a5c0996077a262.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fb3%252Fe8b374004fce63d50df73dcb5e314091%252Fpa%252FDR45963_7d0fc5d4d51ca4cc68ef60008bc83822.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_7d0fc5d4d51ca4cc68ef60008bc83822.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fb3%252Fe8b374004fce63d50df73dcb5e314091%252Fpa%252FDR45963_553f426619be2aa8afd8bbbea06195d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_553f426619be2aa8afd8bbbea06195d6.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fb3%252Fe8b374004fce63d50df73dcb5e314091%252Fpa%252FDR45963_e834f9ed6ccd899a728ec770846bc754.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_e834f9ed6ccd899a728ec770846bc754.jpg already downloaded
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fb3%252Fe8b374004fce63d50df73dcb5e314091%252Fpa%252FDR45963_c60d9c8b30d0517e22c9d7e81ca1c584.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_c60d9c8b30d0517e22c9d7e81ca1c584.jpg already downloaded
2026-03-28 18:38:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ec509d3-cc6b-526d-a90c-7cbc0c665212, identifier: DR45963
2026-03-28 18:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_be98c8f4697988bcfcf341d5ca3ad0d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_0c7bc642e570d431c82f625843c8d574.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with identifier: NY30954
2026-03-28 18:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with identifier: NY30954
2026-03-28 18:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe25d2f-e968-5447-a2bd-ce1d0dc23b05 with identifier: NY30954 to the API
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NY30954>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:30:03Z',
 'fuel_type': 'diesel',
 'id': 'cfe25d2f-e968-5447-a2bd-ce1d0dc23b05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY30954',
 'listing': 'auction',
 'location': 'DE, Kitzingen',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 118299,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_11a7e7b2e73679453baf39496f3c8357.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_02b5575cb42a6a03f5e8e908168dff97.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_2c8d408cfe57c05dd407567b13452535.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_59c3af4348da61ad496ef51abda094aa.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_67e0b1e524f3e5ceb4c81c445c66dec3.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_3ff8a0182f2b2b6cc7c7a0f6c1823d5e.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_bf00b692918c30ef386f08f6e3cb68ee.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_fa78196cccf97b4d7b6b42ec27aa2a9c.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_24168ee0daada83f44c4feacf64e1995.jpg',
                'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_9d3325171794ae0d4a13bade3f139230.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_11a7e7b2e73679453baf39496f3c8357.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78737,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_02b5575cb42a6a03f5e8e908168dff97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_2c8d408cfe57c05dd407567b13452535.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_59c3af4348da61ad496ef51abda094aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_67e0b1e524f3e5ceb4c81c445c66dec3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_3ff8a0182f2b2b6cc7c7a0f6c1823d5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_bf00b692918c30ef386f08f6e3cb68ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88568,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_fa78196cccf97b4d7b6b42ec27aa2a9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_24168ee0daada83f44c4feacf64e1995.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfe25d2f-e968-5447-a2bd-ce1d0dc23b05/cfe25d2f-e968-5447-a2bd-ce1d0dc23b05_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/5e/7c5e2d4adb6234b34e8b32dc81cb3025/pa/NY30954_9d3325171794ae0d4a13bade3f139230.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'MINI Clubman Cooper SD ALL4',
 'transmission': 'automatic',
 'trim': 'ALL4',
 'year': 2018}
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY30954%27 HTTP/1.1" 200 None
2026-03-28 18:38:42 [auto1.de] INFO: Saving data for NY30954: {'created_time': 1774723122.415777, 'last_price_update_time': 1774723122.415789, 'auction_closing_time': 1774884603.0}
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY30954') HTTP/1.1" 204 0
2026-03-28 18:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with identifier: DR45963
2026-03-28 18:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with identifier: DR45963
2026-03-28 18:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ec509d3-cc6b-526d-a90c-7cbc0c665212 with identifier: DR45963 to the API
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DR45963>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:06:30Z',
 'fuel_type': 'petrol',
 'id': '7ec509d3-cc6b-526d-a90c-7cbc0c665212',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR45963',
 'listing': 'auction',
 'location': 'DE, Schweitenkirchen',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 145654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_7f432466afb943f4c1a5c0996077a262.jpg',
                'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_7d0fc5d4d51ca4cc68ef60008bc83822.jpg',
                'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_553f426619be2aa8afd8bbbea06195d6.jpg',
                'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_e834f9ed6ccd899a728ec770846bc754.jpg',
                'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_c60d9c8b30d0517e22c9d7e81ca1c584.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec509d3-cc6b-526d-a90c-7cbc0c665212/7ec509d3-cc6b-526d-a90c-7cbc0c665212_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_7f432466afb943f4c1a5c0996077a262.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec509d3-cc6b-526d-a90c-7cbc0c665212/7ec509d3-cc6b-526d-a90c-7cbc0c665212_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_7d0fc5d4d51ca4cc68ef60008bc83822.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec509d3-cc6b-526d-a90c-7cbc0c665212/7ec509d3-cc6b-526d-a90c-7cbc0c665212_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_553f426619be2aa8afd8bbbea06195d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec509d3-cc6b-526d-a90c-7cbc0c665212/7ec509d3-cc6b-526d-a90c-7cbc0c665212_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_e834f9ed6ccd899a728ec770846bc754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7ec509d3-cc6b-526d-a90c-7cbc0c665212/7ec509d3-cc6b-526d-a90c-7cbc0c665212_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/b3/e8b374004fce63d50df73dcb5e314091/pa/DR45963_c60d9c8b30d0517e22c9d7e81ca1c584.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Dance',
 'transmission': 'manual',
 'trim': 'Dance',
 'year': 2007}
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR45963%27 HTTP/1.1" 200 None
2026-03-28 18:38:42 [auto1.de] INFO: Saving data for DR45963: {'created_time': 1774723122.789598, 'last_price_update_time': 1774723122.789609, 'auction_closing_time': 1774883190.0}
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR45963') HTTP/1.1" 204 0
2026-03-28 18:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_fc3a8d56e886eee562dbdfc60dbe34f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_79fd95ecc376a8d5c3bedfb830a54d08.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_d7c3e16fd70d2a3f62ef2ba4ae314fe7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:42 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-28 18:38:42 [auto1.de] INFO: Scrape type for TK93923: 1
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_0739a639e18216c82634fe0cd3bf6c58.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_0739a639e18216c82634fe0cd3bf6c58.jpg not downloaded yet
2026-03-28 18:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd34290>
2026-03-28 18:38:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_06ed7a71780426c024f766a2c4b5def3.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_06ed7a71780426c024f766a2c4b5def3.jpg saved to cache
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_1e5a871c5cab3599065515b5f3cc8b67.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:43 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-28 18:38:43 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-28 18:38:43 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-28 18:38:43 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-28 18:38:43 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-28 18:38:43 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-28 18:38:43 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-28 18:38:43 [auto1.de] INFO: Scrape type for CS73315: 1
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_4e7168a18fdd77738534a58da4ba54be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_4e7168a18fdd77738534a58da4ba54be.jpg not downloaded yet
2026-03-28 18:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP61394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b212710>
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_3a37003eb8437edffbf56637ee518e34.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_3a37003eb8437edffbf56637ee518e34.jpg saved to cache
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbeaf50>
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_be98c8f4697988bcfcf341d5ca3ad0d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_be98c8f4697988bcfcf341d5ca3ad0d8.jpg saved to cache
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be83590>
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_0c7bc642e570d431c82f625843c8d574.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_0c7bc642e570d431c82f625843c8d574.jpg saved to cache
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7c4d0>
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_fc3a8d56e886eee562dbdfc60dbe34f7.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_fc3a8d56e886eee562dbdfc60dbe34f7.jpg saved to cache
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb23c10>
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_79fd95ecc376a8d5c3bedfb830a54d08.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_79fd95ecc376a8d5c3bedfb830a54d08.jpg saved to cache
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0b710>
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F08%252F0a08d298ed6530b826b0cb948ee6de4f%252Fpa%252FNK26673_d7c3e16fd70d2a3f62ef2ba4ae314fe7.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_d7c3e16fd70d2a3f62ef2ba4ae314fe7.jpg saved to cache
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ea551c45-0267-5902-b613-7e226bab0a90
2026-03-28 18:38:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ea551c45-0267-5902-b613-7e226bab0a90, skipping ID generation
2026-03-28 18:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea551c45-0267-5902-b613-7e226bab0a90 with scrape type 1
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ea551c45-0267-5902-b613-7e226bab0a90 sending to next pipeline
2026-03-28 18:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea551c45-0267-5902-b613-7e226bab0a90, identifier: NK26673
2026-03-28 18:38:43 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:43 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-28 18:38:43 [auto1.de] INFO: Scrape type for SE41978: 2
2026-03-28 18:38:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb5cea64-b980-5449-8a3a-6f61ccf1db55 with identifier: SE41978
2026-03-28 18:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb5cea64-b980-5449-8a3a-6f61ccf1db55 with scrape type 2
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb5cea64-b980-5449-8a3a-6f61ccf1db55 with scrape type 2
2026-03-28 18:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb5cea64-b980-5449-8a3a-6f61ccf1db55, identifier: SE41978
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_87f95c4df944b18a8f6cd47c6fb323de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_87f95c4df944b18a8f6cd47c6fb323de.jpg not downloaded yet
2026-03-28 18:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea551c45-0267-5902-b613-7e226bab0a90 with identifier: NK26673
2026-03-28 18:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea551c45-0267-5902-b613-7e226bab0a90 with identifier: NK26673
2026-03-28 18:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea551c45-0267-5902-b613-7e226bab0a90 with identifier: NK26673 to the API
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_d7c3e16fd70d2a3f62ef2ba4ae314fe7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.4L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:01:49Z',
 'fuel_type': 'diesel',
 'id': 'ea551c45-0267-5902-b613-7e226bab0a90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK26673',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 278263,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_fc3a8d56e886eee562dbdfc60dbe34f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_79fd95ecc376a8d5c3bedfb830a54d08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_678e52ae2dedcd69e9bd9eacb4663852.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73090,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_2cbabe17d84f450dcd94c2f8ac821b49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_d7c3e16fd70d2a3f62ef2ba4ae314fe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_ad90c0df30f3662f2497548b8d9f60ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_14ee9fc87b94b2cceadec9d5ccd52c17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_0b3746df58fe83de8fdbc1f7c1ab85d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_9a9df8b1e8476746567a58a5548e623c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ea551c45-0267-5902-b613-7e226bab0a90/ea551c45-0267-5902-b613-7e226bab0a90_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/08/0a08d298ed6530b826b0cb948ee6de4f/pa/NK26673_0c7bc642e570d431c82f625843c8d574.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Linje Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Linje Inscription AWD',
 'year': 2015}
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK26673%27 HTTP/1.1" 200 None
2026-03-28 18:38:44 [auto1.de] INFO: Saving data for NK26673: {'created_time': 1774723124.015642, 'last_price_update_time': 1774723124.015655, 'auction_closing_time': 1774882909.0}
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK26673') HTTP/1.1" 204 0
2026-03-28 18:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb5cea64-b980-5449-8a3a-6f61ccf1db55 with identifier: SE41978
2026-03-28 18:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb5cea64-b980-5449-8a3a-6f61ccf1db55 with identifier: SE41978
2026-03-28 18:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb5cea64-b980-5449-8a3a-6f61ccf1db55 with identifier: SE41978 to the API
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:46Z',
 'fuel_type': 'petrol',
 'id': 'bb5cea64-b980-5449-8a3a-6f61ccf1db55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE41978',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 137950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Mazda 5 2.0 Sendo',
 'transmission': 'manual',
 'trim': 'Sendo',
 'year': 2015}
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE41978%27 HTTP/1.1" 200 None
2026-03-28 18:38:44 [auto1.de] INFO: Saving data for SE41978: {'auction_closing_time': 1774883326.0, 'created_time': 1774349988.366238, 'last_price_update_time': 1774723124.440306}
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE41978') HTTP/1.1" 204 0
2026-03-28 18:38:44 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-28 18:38:44 [auto1.de] INFO: Scrape type for WB47522: 2
2026-03-28 18:38:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2cbd928-884a-5c3b-ae66-2ec13fe642de with identifier: WB47522
2026-03-28 18:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2cbd928-884a-5c3b-ae66-2ec13fe642de with scrape type 2
2026-03-28 18:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2cbd928-884a-5c3b-ae66-2ec13fe642de with scrape type 2
2026-03-28 18:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2cbd928-884a-5c3b-ae66-2ec13fe642de, identifier: WB47522
2026-03-28 18:38:44 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-28 18:38:44 [auto1.de] INFO: Scrape type for NS35557: 1
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_d15f46c47dcda0cce85b796fbf456057.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_d15f46c47dcda0cce85b796fbf456057.jpg not downloaded yet
2026-03-28 18:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2cbd928-884a-5c3b-ae66-2ec13fe642de with identifier: WB47522
2026-03-28 18:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2cbd928-884a-5c3b-ae66-2ec13fe642de with identifier: WB47522
2026-03-28 18:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2cbd928-884a-5c3b-ae66-2ec13fe642de with identifier: WB47522 to the API
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:03Z',
 'fuel_type': 'diesel',
 'id': 'c2cbd928-884a-5c3b-ae66-2ec13fe642de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB47522',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 203186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI First Edition',
 'transmission': 'automatic',
 'trim': 'First Edition',
 'year': 2020}
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB47522%27 HTTP/1.1" 200 None
2026-03-28 18:38:44 [auto1.de] INFO: Saving data for WB47522: {'auction_closing_time': 1774885623.0, 'created_time': 1774032119.719153, 'last_price_update_time': 1774723124.939636}
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB47522') HTTP/1.1" 204 0
2026-03-28 18:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG66001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MX21840> (referer: https://www.auto1.com/v1/car-details-view/MX21840/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_8dac24721130b8c3726998a49944c6d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:44 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-28 18:38:44 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-28 18:38:44 [auto1.de] INFO: Scrape type for JL46304: 1
2026-03-28 18:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RW68722> (referer: https://www.auto1.com/v1/car-details-view/RW68722/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU21003/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a1d5810>
2026-03-28 18:38:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F3d%252Fc33daf030435008d14d9c97b19eeafba%252Fpa%252FAU44008_1e5a871c5cab3599065515b5f3cc8b67.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_1e5a871c5cab3599065515b5f3cc8b67.jpg saved to cache
2026-03-28 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6
2026-03-28 18:38:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6, skipping ID generation
2026-03-28 18:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with scrape type 1
2026-03-28 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 sending to next pipeline
2026-03-28 18:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6, identifier: AU44008
2026-03-28 18:38:45 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-28 18:38:45 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-28 18:38:45 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-28 18:38:45 [auto1.de] INFO: Scrape type for LW95470: 1
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_9a901388445663d8fa9c99ea01ca105c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_9a901388445663d8fa9c99ea01ca105c.jpg not downloaded yet
2026-03-28 18:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with identifier: AU44008
2026-03-28 18:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with identifier: AU44008
2026-03-28 18:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6 with identifier: AU44008 to the API
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_1e5a871c5cab3599065515b5f3cc8b67.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'petrol',
 'id': '91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU44008',
 'listing': 'auction',
 'location': 'DE, Gelsenkirchen',
 'make': 'BMW',
 'model': '1er',
 'odometer': 143506,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_e6e0aa86a03f1e8a5edc1f000334e6ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_1e5a871c5cab3599065515b5f3cc8b67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_9ad6ecec4c6a39f9535ba20c50c2124f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_ae1467efb90d770b900dc219da4e2c16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_9d5a3be31da48620bfaa7e1cfae2714d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_ca3ae1ceff51da808a87aeed45fc34eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_3a37003eb8437edffbf56637ee518e34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_94c237bcf4ef20771295d3c8c66548a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_d89d69eb25e68a76218840f4fcb6eb6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6/91f7a646-b1dc-5d6b-a838-d12e5e4f2ad6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/3d/c33daf030435008d14d9c97b19eeafba/pa/AU44008_6005d2461745eca2d9e5bcf1d3822f9d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-08-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU44008%27 HTTP/1.1" 200 None
2026-03-28 18:38:45 [auto1.de] INFO: Saving data for AU44008: {'created_time': 1774723125.533629, 'last_price_update_time': 1774723125.533641, 'auction_closing_time': 1774882995.0}
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU44008') HTTP/1.1" 204 0
2026-03-28 18:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_6dedb9b4c690910e6e2a002f8d203086.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_e62662df02360fa0615e8cda14d9c516.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_4e7168a18fdd77738534a58da4ba54be.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:45 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-28 18:38:45 [auto1.de] INFO: Scrape type for LL96634: 2
2026-03-28 18:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf7eada1-8700-581d-ab72-ecb7c2ce9260 with identifier: LL96634
2026-03-28 18:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf7eada1-8700-581d-ab72-ecb7c2ce9260 with scrape type 2
2026-03-28 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf7eada1-8700-581d-ab72-ecb7c2ce9260 with scrape type 2
2026-03-28 18:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf7eada1-8700-581d-ab72-ecb7c2ce9260, identifier: LL96634
2026-03-28 18:38:45 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-28 18:38:45 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-28 18:38:45 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-28 18:38:45 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-28 18:38:45 [auto1.de] INFO: Scrape type for GY54695: 2
2026-03-28 18:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with identifier: GY54695
2026-03-28 18:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with scrape type 2
2026-03-28 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with scrape type 2
2026-03-28 18:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0, identifier: GY54695
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_a37b33842b1705dca3c449fb1d1b80b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_a37b33842b1705dca3c449fb1d1b80b2.jpg not downloaded yet
2026-03-28 18:38:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf7eada1-8700-581d-ab72-ecb7c2ce9260 with identifier: LL96634
2026-03-28 18:38:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf7eada1-8700-581d-ab72-ecb7c2ce9260 with identifier: LL96634
2026-03-28 18:38:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf7eada1-8700-581d-ab72-ecb7c2ce9260 with identifier: LL96634 to the API
2026-03-28 18:38:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:28:06Z',
 'fuel_type': 'petrol',
 'id': 'cf7eada1-8700-581d-ab72-ecb7c2ce9260',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL96634',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 138838,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-27',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Night & Day',
 'transmission': 'manual',
 'trim': 'Night & Day',
 'year': 2010}
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL96634%27 HTTP/1.1" 200 None
2026-03-28 18:38:46 [auto1.de] INFO: Saving data for LL96634: {'auction_closing_time': 1774884486.0, 'created_time': 1773428606.648739, 'last_price_update_time': 1774723126.235594}
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL96634') HTTP/1.1" 204 0
2026-03-28 18:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3a25024-0e37-5a46-9b5b-91027aade4ba with identifier: MX21840
2026-03-28 18:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3a25024-0e37-5a46-9b5b-91027aade4ba with scrape type 1
2026-03-28 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_37a6dd2a31920e15e2ccec3be3a60f31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_37a6dd2a31920e15e2ccec3be3a60f31.jpg not downloaded yet
2026-03-28 18:38:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbcdb90>
2026-03-28 18:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_8dac24721130b8c3726998a49944c6d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_8dac24721130b8c3726998a49944c6d7.jpg saved to cache
2026-03-28 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b280a314-9b68-5026-a5dd-2cb64bbac5c5 with identifier: RW68722
2026-03-28 18:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b280a314-9b68-5026-a5dd-2cb64bbac5c5 with scrape type 1
2026-03-28 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_300a3e2e7b126c5394e439b099b7f4b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_300a3e2e7b126c5394e439b099b7f4b0.jpg not downloaded yet
2026-03-28 18:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with identifier: GY54695
2026-03-28 18:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with identifier: GY54695
2026-03-28 18:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0 with identifier: GY54695 to the API
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:22:26Z',
 'fuel_type': 'petrol',
 'id': '639f10a2-6dc7-5d4b-a8d4-e13a1b83c7c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY54695',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 126851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-13',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2017}
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY54695%27 HTTP/1.1" 200 None
2026-03-28 18:38:46 [auto1.de] INFO: Saving data for GY54695: {'auction_closing_time': 1774884146.0, 'created_time': 1773466647.412847, 'last_price_update_time': 1774723126.907155}
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY54695') HTTP/1.1" 204 0
2026-03-28 18:38:46 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-28 18:38:46 [auto1.de] INFO: Scrape type for HV52023: 1
2026-03-28 18:38:46 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-28 18:38:46 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-28 18:38:46 [auto1.de] INFO: Scrape type for TV85934: 2
2026-03-28 18:38:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96228e4a-723c-5881-9316-69d26393276a with identifier: TV85934
2026-03-28 18:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96228e4a-723c-5881-9316-69d26393276a with scrape type 2
2026-03-28 18:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96228e4a-723c-5881-9316-69d26393276a with scrape type 2
2026-03-28 18:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96228e4a-723c-5881-9316-69d26393276a, identifier: TV85934
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_35cdc96eb37d9f52493a0396b1e3174d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_35cdc96eb37d9f52493a0396b1e3174d.jpg not downloaded yet
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_19c236b4ca41b8113f60308f898fe3d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_19c236b4ca41b8113f60308f898fe3d2.jpg not downloaded yet
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_50901670a1fc0dfce2d9cf01c40ade57.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_50901670a1fc0dfce2d9cf01c40ade57.jpg not downloaded yet
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1cbb50>
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd2%252F76%252Fd276106d3463073574c7e8ee0bad2e42%252Fpa%252FFL46038_6dedb9b4c690910e6e2a002f8d203086.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_6dedb9b4c690910e6e2a002f8d203086.jpg saved to cache
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da
2026-03-28 18:38:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da, skipping ID generation
2026-03-28 18:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with scrape type 1
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da sending to next pipeline
2026-03-28 18:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da, identifier: FL46038
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb90710>
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252F3b%252F0b3b088a208fd11750d5cf8df9a52263%252Fpa%252FKA54911_e62662df02360fa0615e8cda14d9c516.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_e62662df02360fa0615e8cda14d9c516.jpg saved to cache
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d897b9bb-8551-5964-9ce8-4570df9c55fa
2026-03-28 18:38:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d897b9bb-8551-5964-9ce8-4570df9c55fa, skipping ID generation
2026-03-28 18:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d897b9bb-8551-5964-9ce8-4570df9c55fa with scrape type 1
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d897b9bb-8551-5964-9ce8-4570df9c55fa sending to next pipeline
2026-03-28 18:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d897b9bb-8551-5964-9ce8-4570df9c55fa, identifier: KA54911
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe1810>
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_4e7168a18fdd77738534a58da4ba54be.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_4e7168a18fdd77738534a58da4ba54be.jpg saved to cache
2026-03-28 18:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_87f95c4df944b18a8f6cd47c6fb323de.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96228e4a-723c-5881-9316-69d26393276a with identifier: TV85934
2026-03-28 18:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96228e4a-723c-5881-9316-69d26393276a with identifier: TV85934
2026-03-28 18:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96228e4a-723c-5881-9316-69d26393276a with identifier: TV85934 to the API
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:06Z',
 'fuel_type': 'petrol',
 'id': '96228e4a-723c-5881-9316-69d26393276a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV85934',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 170231,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI EcoFuel Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2013}
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV85934%27 HTTP/1.1" 200 None
2026-03-28 18:38:47 [auto1.de] INFO: Saving data for TV85934: {'auction_closing_time': 1774886106.0, 'created_time': 1774118451.296094, 'last_price_update_time': 1774723127.720047}
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV85934') HTTP/1.1" 204 0
2026-03-28 18:38:47 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-28 18:38:47 [auto1.de] INFO: Scrape type for YT21216: 1
2026-03-28 18:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with identifier: FL46038
2026-03-28 18:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with identifier: FL46038
2026-03-28 18:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65ff5f2a-66d6-5a28-ab61-cb2cb70f66da with identifier: FL46038 to the API
2026-03-28 18:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_6dedb9b4c690910e6e2a002f8d203086.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:22:38Z',
 'fuel_type': 'petrol',
 'id': '65ff5f2a-66d6-5a28-ab61-cb2cb70f66da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL46038',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 113024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_fbe777d550c41e32b7f2e83587d76a47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_f0684602dcbae9f729f39c6b982db07d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_3d7de0ab6dedf36b68cc3cb71544b90b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_9eaedeec7acb0637b6b8c5089231c904.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2436452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_06ed7a71780426c024f766a2c4b5def3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2412881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_be98c8f4697988bcfcf341d5ca3ad0d8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_e408bf49364ddc10c49d145350b5071a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2449326,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_8dac24721130b8c3726998a49944c6d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_1970dbb4320b7733d5dd7a28a53f830f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65ff5f2a-66d6-5a28-ab61-cb2cb70f66da/65ff5f2a-66d6-5a28-ab61-cb2cb70f66da_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd2/76/d276106d3463073574c7e8ee0bad2e42/pa/FL46038_6dedb9b4c690910e6e2a002f8d203086.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL46038%27 HTTP/1.1" 200 None
2026-03-28 18:38:48 [auto1.de] INFO: Saving data for FL46038: {'created_time': 1774723128.140135, 'last_price_update_time': 1774723128.140148, 'auction_closing_time': 1774884158.0}
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL46038') HTTP/1.1" 204 0
2026-03-28 18:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d897b9bb-8551-5964-9ce8-4570df9c55fa with identifier: KA54911
2026-03-28 18:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d897b9bb-8551-5964-9ce8-4570df9c55fa with identifier: KA54911
2026-03-28 18:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d897b9bb-8551-5964-9ce8-4570df9c55fa with identifier: KA54911 to the API
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_e62662df02360fa0615e8cda14d9c516.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:13:38Z',
 'fuel_type': 'petrol',
 'id': 'd897b9bb-8551-5964-9ce8-4570df9c55fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA54911',
 'listing': 'auction',
 'location': 'DE, Elmshorn',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 137843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76643,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_e62662df02360fa0615e8cda14d9c516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70252,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_48043670eec5203ad917d3c75b953e90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_d216c8f979aca3cd4fd4d4fc6d1a3951.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65995,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_2757a0142e3937c968447d107651f3b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d897b9bb-8551-5964-9ce8-4570df9c55fa/d897b9bb-8551-5964-9ce8-4570df9c55fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/3b/0b3b088a208fd11750d5cf8df9a52263/pa/KA54911_dd4ab76783804bc77aa3c699bd9b5e03.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2007}
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA54911%27 HTTP/1.1" 200 None
2026-03-28 18:38:48 [auto1.de] INFO: Saving data for KA54911: {'created_time': 1774723128.532903, 'last_price_update_time': 1774723128.532917, 'auction_closing_time': 1774883618.0}
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA54911') HTTP/1.1" 204 0
2026-03-28 18:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_be89a8696ed961d4450e20fe3f6c89f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:48 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-28 18:38:48 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-28 18:38:48 [auto1.de] INFO: Scrape type for YN15081: 2
2026-03-28 18:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eea4de39-9e7f-5d79-ac4b-116917e2eea1 with identifier: YN15081
2026-03-28 18:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eea4de39-9e7f-5d79-ac4b-116917e2eea1 with scrape type 2
2026-03-28 18:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eea4de39-9e7f-5d79-ac4b-116917e2eea1 with scrape type 2
2026-03-28 18:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eea4de39-9e7f-5d79-ac4b-116917e2eea1, identifier: YN15081
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_2203ce7b39ede3c371a8225653dc946e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_2203ce7b39ede3c371a8225653dc946e.jpg not downloaded yet
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_7d01a6941a6af66e46018f4c69bb4ae2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_7d01a6941a6af66e46018f4c69bb4ae2.jpg not downloaded yet
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_d4622dad178759c71a63a2fefccb0e0e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_d4622dad178759c71a63a2fefccb0e0e.jpg not downloaded yet
2026-03-28 18:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eea4de39-9e7f-5d79-ac4b-116917e2eea1 with identifier: YN15081
2026-03-28 18:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eea4de39-9e7f-5d79-ac4b-116917e2eea1 with identifier: YN15081
2026-03-28 18:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eea4de39-9e7f-5d79-ac4b-116917e2eea1 with identifier: YN15081 to the API
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:11:46Z',
 'fuel_type': 'diesel',
 'id': 'eea4de39-9e7f-5d79-ac4b-116917e2eea1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN15081',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 103524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-08',
 'seller_name': None,
 'title': 'Audi A1 1.6 TDI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN15081%27 HTTP/1.1" 200 None
2026-03-28 18:38:49 [auto1.de] INFO: Saving data for YN15081: {'auction_closing_time': 1774883506.0, 'created_time': 1773467628.731985, 'last_price_update_time': 1774723129.059219}
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN15081') HTTP/1.1" 204 0
2026-03-28 18:38:49 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-28 18:38:49 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-28 18:38:49 [auto1.de] INFO: Scrape type for EH91304: 2
2026-03-28 18:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: badad7c7-3054-5c43-ac97-c6b5556b9350 with identifier: EH91304
2026-03-28 18:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item badad7c7-3054-5c43-ac97-c6b5556b9350 with scrape type 2
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item badad7c7-3054-5c43-ac97-c6b5556b9350 with scrape type 2
2026-03-28 18:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: badad7c7-3054-5c43-ac97-c6b5556b9350, identifier: EH91304
2026-03-28 18:38:49 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-28 18:38:49 [auto1.de] INFO: Scrape type for PR24120: 1
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_95293dc7fe59384e1252961c6d470691.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_95293dc7fe59384e1252961c6d470691.jpg not downloaded yet
2026-03-28 18:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: badad7c7-3054-5c43-ac97-c6b5556b9350 with identifier: EH91304
2026-03-28 18:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: badad7c7-3054-5c43-ac97-c6b5556b9350 with identifier: EH91304
2026-03-28 18:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: badad7c7-3054-5c43-ac97-c6b5556b9350 with identifier: EH91304 to the API
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:33:27Z',
 'fuel_type': 'diesel',
 'id': 'badad7c7-3054-5c43-ac97-c6b5556b9350',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH91304',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 261392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-24',
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.6 JTDM Veloce',
 'transmission': 'manual',
 'trim': 'Veloce',
 'year': 2013}
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91304%27 HTTP/1.1" 200 None
2026-03-28 18:38:49 [auto1.de] INFO: Saving data for EH91304: {'auction_closing_time': 1774884807.0, 'created_time': 1774349845.744843, 'last_price_update_time': 1774723129.550772}
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH91304') HTTP/1.1" 204 0
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_f342ca6e6dbd0b90c485eb04556ff932.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_f342ca6e6dbd0b90c485eb04556ff932.jpg not downloaded yet
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_5e6d3c953194d50b9139c131ec2dec42.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_5e6d3c953194d50b9139c131ec2dec42.jpg not downloaded yet
2026-03-28 18:38:49 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-28 18:38:49 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-28 18:38:49 [auto1.de] INFO: Scrape type for RR27166: 2
2026-03-28 18:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88c03da-f250-560c-9535-18ee7c4faf1f with identifier: RR27166
2026-03-28 18:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88c03da-f250-560c-9535-18ee7c4faf1f with scrape type 2
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88c03da-f250-560c-9535-18ee7c4faf1f with scrape type 2
2026-03-28 18:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f88c03da-f250-560c-9535-18ee7c4faf1f, identifier: RR27166
2026-03-28 18:38:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b034cd0>
2026-03-28 18:38:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_87f95c4df944b18a8f6cd47c6fb323de.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_87f95c4df944b18a8f6cd47c6fb323de.jpg saved to cache
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:38:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b025990>
2026-03-28 18:38:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F3b%252F853b18bb7e7ed3b9535dfd71dd8bee0e%252Fpa%252FYH18669_be89a8696ed961d4450e20fe3f6c89f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_be89a8696ed961d4450e20fe3f6c89f2.jpg saved to cache
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5
2026-03-28 18:38:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 980b4369-f2a0-571f-b5fc-859ae3eb91b5, skipping ID generation
2026-03-28 18:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with scrape type 1
2026-03-28 18:38:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 980b4369-f2a0-571f-b5fc-859ae3eb91b5 sending to next pipeline
2026-03-28 18:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 980b4369-f2a0-571f-b5fc-859ae3eb91b5, identifier: YH18669
2026-03-28 18:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_50901670a1fc0dfce2d9cf01c40ade57.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f88c03da-f250-560c-9535-18ee7c4faf1f with identifier: RR27166
2026-03-28 18:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f88c03da-f250-560c-9535-18ee7c4faf1f with identifier: RR27166
2026-03-28 18:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f88c03da-f250-560c-9535-18ee7c4faf1f with identifier: RR27166 to the API
2026-03-28 18:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:49:07Z',
 'fuel_type': 'diesel',
 'id': 'f88c03da-f250-560c-9535-18ee7c4faf1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR27166',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 93661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR27166%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [auto1.de] INFO: Saving data for RR27166: {'auction_closing_time': 1774885747.0, 'created_time': 1774118809.468489, 'last_price_update_time': 1774723130.230865}
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RR27166') HTTP/1.1" 204 0
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_beac3eda8fdcf74629c4a44c5a13a682.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_beac3eda8fdcf74629c4a44c5a13a682.jpg not downloaded yet
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_8009120486e60996b5e53fac457b0c9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_8009120486e60996b5e53fac457b0c9a.jpg not downloaded yet
2026-03-28 18:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NZ79152> (referer: https://www.auto1.com/v1/car-details-view/NZ79152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with identifier: YH18669
2026-03-28 18:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with identifier: YH18669
2026-03-28 18:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 980b4369-f2a0-571f-b5fc-859ae3eb91b5 with identifier: YH18669 to the API
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_be89a8696ed961d4450e20fe3f6c89f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:21Z',
 'fuel_type': 'petrol',
 'id': '980b4369-f2a0-571f-b5fc-859ae3eb91b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH18669',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 181867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_be89a8696ed961d4450e20fe3f6c89f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_275d319bc0c31035a845b2b4f86bf215.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_60c410c2b4e097fab6b6d565813b7c4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_05c9b6f7ceab98464b38ed4488a8e1d0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_980b4369-f2a0-571f-b5fc-859ae3eb91b5/980b4369-f2a0-571f-b5fc-859ae3eb91b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/3b/853b18bb7e7ed3b9535dfd71dd8bee0e/pa/YH18669_422c126e3ddbda5254b4606d4559d6f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2014}
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH18669%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [auto1.de] INFO: Saving data for YH18669: {'created_time': 1774723130.72701, 'last_price_update_time': 1774723130.727021, 'auction_closing_time': 1774886181.0}
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH18669') HTTP/1.1" 204 0
2026-03-28 18:38:50 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [auto1.de] INFO: Scrape type for SJ72548: 1
2026-03-28 18:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_35f37f987890f6ecc204de39a2107c3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_35f37f987890f6ecc204de39a2107c3d.jpg not downloaded yet
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_7b47d3597258d1ca0d5ea2793b67fb3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_7b47d3597258d1ca0d5ea2793b67fb3d.jpg not downloaded yet
2026-03-28 18:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:50 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-28 18:38:50 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-28 18:38:50 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [auto1.de] INFO: Scrape type for RM21545: 2
2026-03-28 18:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596fa0f5-2669-5de8-a958-19c759cea962 with identifier: RM21545
2026-03-28 18:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596fa0f5-2669-5de8-a958-19c759cea962 with scrape type 2
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596fa0f5-2669-5de8-a958-19c759cea962 with scrape type 2
2026-03-28 18:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 596fa0f5-2669-5de8-a958-19c759cea962, identifier: RM21545
2026-03-28 18:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD40697> (referer: https://www.auto1.com/v1/car-details-view/FD40697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS73315/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc9afd0>
2026-03-28 18:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_50901670a1fc0dfce2d9cf01c40ade57.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_50901670a1fc0dfce2d9cf01c40ade57.jpg saved to cache
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with identifier: NZ79152
2026-03-28 18:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with scrape type 1
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_64de150f9bca58460ef84939e819ee22.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_64de150f9bca58460ef84939e819ee22.jpg not downloaded yet
2026-03-28 18:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 596fa0f5-2669-5de8-a958-19c759cea962 with identifier: RM21545
2026-03-28 18:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 596fa0f5-2669-5de8-a958-19c759cea962 with identifier: RM21545
2026-03-28 18:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 596fa0f5-2669-5de8-a958-19c759cea962 with identifier: RM21545 to the API
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:51:32Z',
 'fuel_type': 'petrol',
 'id': '596fa0f5-2669-5de8-a958-19c759cea962',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM21545',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 38460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-28',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Prime 4WD',
 'transmission': 'automatic',
 'trim': 'Prime 4WD',
 'year': 2024}
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM21545%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [auto1.de] INFO: Saving data for RM21545: {'auction_closing_time': 1774885892.0, 'created_time': 1773400217.223871, 'last_price_update_time': 1774723131.328884}
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM21545') HTTP/1.1" 204 0
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_90ec2b140a77c4ae5dfc05524f5724b4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_90ec2b140a77c4ae5dfc05524f5724b4.jpg not downloaded yet
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_9931fcadd037feee480c14be129fedb2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_9931fcadd037feee480c14be129fedb2.jpg not downloaded yet
2026-03-28 18:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:51 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [auto1.de] INFO: Scrape type for SY42721: 1
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_b4039d2f0c49099e1eaea487b7ff1ce4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_b4039d2f0c49099e1eaea487b7ff1ce4.jpg not downloaded yet
2026-03-28 18:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_f342ca6e6dbd0b90c485eb04556ff932.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_1f1a181f140fa65f1bc1127b9e7e13da.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_1f1a181f140fa65f1bc1127b9e7e13da.jpg not downloaded yet
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_7a479dab0daf04d51c52a8dc5d5d6c9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_7a479dab0daf04d51c52a8dc5d5d6c9d.jpg not downloaded yet
2026-03-28 18:38:51 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [auto1.de] INFO: Scrape type for UC78524: 2
2026-03-28 18:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8847ecc-e35b-57a1-b118-4c80666801a2 with identifier: UC78524
2026-03-28 18:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8847ecc-e35b-57a1-b118-4c80666801a2 with scrape type 2
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8847ecc-e35b-57a1-b118-4c80666801a2 with scrape type 2
2026-03-28 18:38:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8847ecc-e35b-57a1-b118-4c80666801a2, identifier: UC78524
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_05178aeb03ce03a978c0255d089ffd76.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_05178aeb03ce03a978c0255d089ffd76.jpg not downloaded yet
2026-03-28 18:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ18953> (referer: https://www.auto1.com/v1/car-details-view/GJ18953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:51 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 6004 | hits on page: 40
2026-03-28 18:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 532327ad-702b-5c8b-9114-da01ba67ec6a with identifier: FD40697
2026-03-28 18:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532327ad-702b-5c8b-9114-da01ba67ec6a with scrape type 1
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_38b67fc972d3c4fa1b60c3938c1b8ccf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_38b67fc972d3c4fa1b60c3938c1b8ccf.jpg not downloaded yet
2026-03-28 18:38:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8847ecc-e35b-57a1-b118-4c80666801a2 with identifier: UC78524
2026-03-28 18:38:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8847ecc-e35b-57a1-b118-4c80666801a2 with identifier: UC78524
2026-03-28 18:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8847ecc-e35b-57a1-b118-4c80666801a2 with identifier: UC78524 to the API
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:15:33Z',
 'fuel_type': 'petrol',
 'id': 'f8847ecc-e35b-57a1-b118-4c80666801a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC78524',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20 Active',
 'odometer': 59286,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-07',
 'seller_name': None,
 'title': 'Hyundai i20 Active 1.0 TGDI Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2020}
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78524%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [auto1.de] INFO: Saving data for UC78524: {'auction_closing_time': 1774883733.0, 'created_time': 1774034133.334107, 'last_price_update_time': 1774723131.961574}
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC78524') HTTP/1.1" 204 0
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_df046884922ec83e12f3fa581a7d0e0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_df046884922ec83e12f3fa581a7d0e0b.jpg not downloaded yet
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_54b24147adc0e8133b03dc3217e516ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_54b24147adc0e8133b03dc3217e516ea.jpg not downloaded yet
2026-03-28 18:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_7b47d3597258d1ca0d5ea2793b67fb3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:52 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [auto1.de] INFO: Scrape type for WG52031: 1
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_9f492fd02559e9d816226ebffd3dda1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9f492fd02559e9d816226ebffd3dda1e.jpg not downloaded yet
2026-03-28 18:38:52 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-28 18:38:52 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [auto1.de] INFO: Scrape type for KK21790: 1
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_a7aca0729cf858a23678b41323cc1fa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_a7aca0729cf858a23678b41323cc1fa2.jpg not downloaded yet
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_579dad020708aab297f8c8e7ee989ccb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_579dad020708aab297f8c8e7ee989ccb.jpg not downloaded yet
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_4da4908d78a809de8234919da94c2e7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_4da4908d78a809de8234919da94c2e7c.jpg not downloaded yet
2026-03-28 18:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK93923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR83992> (referer: https://www.auto1.com/v1/car-details-view/GR83992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:52 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [auto1.de] INFO: Scrape type for RY75144: 2
2026-03-28 18:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with identifier: RY75144
2026-03-28 18:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with scrape type 2
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with scrape type 2
2026-03-28 18:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b, identifier: RY75144
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_e223374f4ff828ab347268ce7da6acad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_e223374f4ff828ab347268ce7da6acad.jpg not downloaded yet
2026-03-28 18:38:52 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [auto1.de] INFO: Scrape type for TV45930: 1
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_32fd853debc61edee4502211ca9d09a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_32fd853debc61edee4502211ca9d09a3.jpg not downloaded yet
2026-03-28 18:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ69536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b012350>
2026-03-28 18:38:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_f342ca6e6dbd0b90c485eb04556ff932.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_f342ca6e6dbd0b90c485eb04556ff932.jpg saved to cache
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 392ce6f0-1e5b-5695-8f94-a24c39110444 with identifier: GJ18953
2026-03-28 18:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392ce6f0-1e5b-5695-8f94-a24c39110444 with scrape type 1
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 392ce6f0-1e5b-5695-8f94-a24c39110444
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_177c00481cab5331d78e3f7bbd6baf19.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_177c00481cab5331d78e3f7bbd6baf19.jpg not downloaded yet
2026-03-28 18:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with identifier: RY75144
2026-03-28 18:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with identifier: RY75144
2026-03-28 18:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b with identifier: RY75144 to the API
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:32:57Z',
 'fuel_type': 'petrol',
 'id': '8c1d9c0f-bbed-551a-81e7-b1d0810d5e4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY75144',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 224496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY75144%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [auto1.de] INFO: Saving data for RY75144: {'auction_closing_time': 1774884777.0, 'created_time': 1773467166.825408, 'last_price_update_time': 1774723132.701219}
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY75144') HTTP/1.1" 204 0
2026-03-28 18:38:52 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [auto1.de] INFO: Scrape type for BX11542: 2
2026-03-28 18:38:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with identifier: BX11542
2026-03-28 18:38:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with scrape type 2
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with scrape type 2
2026-03-28 18:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2dc50cf-e7f5-5826-b9e8-f39c7a089710, identifier: BX11542
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_9549a418e210f6ca90fd892926c1faa8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9549a418e210f6ca90fd892926c1faa8.jpg not downloaded yet
2026-03-28 18:38:52 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [auto1.de] INFO: Scrape type for DZ20117: 1
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_c64053322bcac66cf7190b868eae85d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_c64053322bcac66cf7190b868eae85d0.jpg not downloaded yet
2026-03-28 18:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_4c9ce1ea5076e50b4efc354ba060725f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_4c9ce1ea5076e50b4efc354ba060725f.jpg not downloaded yet
2026-03-28 18:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_b4039d2f0c49099e1eaea487b7ff1ce4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_7a479dab0daf04d51c52a8dc5d5d6c9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with identifier: BX11542
2026-03-28 18:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with identifier: BX11542
2026-03-28 18:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2dc50cf-e7f5-5826-b9e8-f39c7a089710 with identifier: BX11542 to the API
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:36:13Z',
 'fuel_type': 'diesel',
 'id': 'f2dc50cf-e7f5-5826-b9e8-f39c7a089710',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX11542',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 124705,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-25',
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11542%27 HTTP/1.1" 200 None
2026-03-28 18:38:53 [auto1.de] INFO: Saving data for BX11542: {'auction_closing_time': 1774884973.0, 'created_time': 1774089290.329934, 'last_price_update_time': 1774723133.365105}
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX11542') HTTP/1.1" 204 0
2026-03-28 18:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7e090>
2026-03-28 18:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_7b47d3597258d1ca0d5ea2793b67fb3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_7b47d3597258d1ca0d5ea2793b67fb3d.jpg saved to cache
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with identifier: GR83992
2026-03-28 18:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with scrape type 1
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_8cfc597f0b891bba0106069112986f5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_8cfc597f0b891bba0106069112986f5a.jpg not downloaded yet
2026-03-28 18:38:53 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-28 18:38:53 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-28 18:38:53 [auto1.de] INFO: Scrape type for DN27813: 2
2026-03-28 18:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d634bd74-c1f6-5fe3-b1e2-142c8b353073 with identifier: DN27813
2026-03-28 18:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d634bd74-c1f6-5fe3-b1e2-142c8b353073 with scrape type 2
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d634bd74-c1f6-5fe3-b1e2-142c8b353073 with scrape type 2
2026-03-28 18:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d634bd74-c1f6-5fe3-b1e2-142c8b353073, identifier: DN27813
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_5ad17c0bb863fdebf7b4ada0eba50c8b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_5ad17c0bb863fdebf7b4ada0eba50c8b.jpg not downloaded yet
2026-03-28 18:38:53 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-28 18:38:53 [auto1.de] INFO: Scrape type for BR60141: 2
2026-03-28 18:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with identifier: BR60141
2026-03-28 18:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with scrape type 2
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with scrape type 2
2026-03-28 18:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2, identifier: BR60141
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_24ec9766287807447b3490ce48a59315.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_24ec9766287807447b3490ce48a59315.jpg not downloaded yet
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_92876aa53e9ca8e6807bcbddf1ba6abc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_92876aa53e9ca8e6807bcbddf1ba6abc.jpg not downloaded yet
2026-03-28 18:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_a7aca0729cf858a23678b41323cc1fa2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d634bd74-c1f6-5fe3-b1e2-142c8b353073 with identifier: DN27813
2026-03-28 18:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d634bd74-c1f6-5fe3-b1e2-142c8b353073 with identifier: DN27813
2026-03-28 18:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d634bd74-c1f6-5fe3-b1e2-142c8b353073 with identifier: DN27813 to the API
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:44:07Z',
 'fuel_type': 'petrol',
 'id': 'd634bd74-c1f6-5fe3-b1e2-142c8b353073',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN27813',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 162149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN27813%27 HTTP/1.1" 200 None
2026-03-28 18:38:54 [auto1.de] INFO: Saving data for DN27813: {'auction_closing_time': 1774885447.0, 'created_time': 1773467068.601377, 'last_price_update_time': 1774723134.095984}
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN27813') HTTP/1.1" 204 0
2026-03-28 18:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with identifier: BR60141
2026-03-28 18:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with identifier: BR60141
2026-03-28 18:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b57e57e-74f2-5cfb-9a85-b4e9244a55e2 with identifier: BR60141 to the API
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:58Z',
 'fuel_type': 'diesel',
 'id': '2b57e57e-74f2-5cfb-9a85-b4e9244a55e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR60141',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 204753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-19',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR60141%27 HTTP/1.1" 200 None
2026-03-28 18:38:54 [auto1.de] INFO: Saving data for BR60141: {'auction_closing_time': 1774886338.0, 'created_time': 1774118789.272518, 'last_price_update_time': 1774723134.408469}
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR60141') HTTP/1.1" 204 0
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_602aa21aa6ce612d49dc40c05127af9b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_602aa21aa6ce612d49dc40c05127af9b.jpg not downloaded yet
2026-03-28 18:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS35557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_4da4908d78a809de8234919da94c2e7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:54 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-28 18:38:54 [auto1.de] INFO: Scrape type for HZ35402: 2
2026-03-28 18:38:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with identifier: HZ35402
2026-03-28 18:38:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with scrape type 2
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with scrape type 2
2026-03-28 18:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb, identifier: HZ35402
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_5ff1e9b1365df036ab7cfac77e378760.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_5ff1e9b1365df036ab7cfac77e378760.jpg not downloaded yet
2026-03-28 18:38:54 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-28 18:38:54 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-28 18:38:54 [auto1.de] INFO: Scrape type for YA36470: 1
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_428395e95a2a9a676b68aa0f8f056349.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_428395e95a2a9a676b68aa0f8f056349.jpg not downloaded yet
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_b899a5f688028251cc677fa875260b5a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_b899a5f688028251cc677fa875260b5a.jpg not downloaded yet
2026-03-28 18:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP61394> (referer: https://www.auto1.com/v1/car-details-view/TP61394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd8a690>
2026-03-28 18:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_b4039d2f0c49099e1eaea487b7ff1ce4.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_b4039d2f0c49099e1eaea487b7ff1ce4.jpg saved to cache
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1ca110>
2026-03-28 18:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_7a479dab0daf04d51c52a8dc5d5d6c9d.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_7a479dab0daf04d51c52a8dc5d5d6c9d.jpg saved to cache
2026-03-28 18:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with identifier: HZ35402
2026-03-28 18:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with identifier: HZ35402
2026-03-28 18:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0aa56d61-0b31-5a5a-8edf-f7216ef165cb with identifier: HZ35402 to the API
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:15:00Z',
 'fuel_type': 'petrol',
 'id': '0aa56d61-0b31-5a5a-8edf-f7216ef165cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ35402',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 39730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ35402%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [auto1.de] INFO: Saving data for HZ35402: {'auction_closing_time': 1774883700.0, 'created_time': 1774349499.569714, 'last_price_update_time': 1774723135.017087}
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ35402') HTTP/1.1" 204 0
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_b16bfacbd5198042bc3b89e6a722bb34.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_b16bfacbd5198042bc3b89e6a722bb34.jpg not downloaded yet
2026-03-28 18:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_177c00481cab5331d78e3f7bbd6baf19.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:55 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [auto1.de] INFO: Scrape type for WA51516: 1
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_240f0c6420114214658bebc4acb098fc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_240f0c6420114214658bebc4acb098fc.jpg not downloaded yet
2026-03-28 18:38:55 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [auto1.de] INFO: Scrape type for VR29597: 1
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_66ab6be47152ceaf7c884b8409bac408.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_66ab6be47152ceaf7c884b8409bac408.jpg not downloaded yet
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_7911dc32994eb2944845712b0b39f50f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_7911dc32994eb2944845712b0b39f50f.jpg not downloaded yet
2026-03-28 18:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HV52023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JL46304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_4a823dbc5cf2c138a3d9b32183c5d182.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_4a823dbc5cf2c138a3d9b32183c5d182.jpg not downloaded yet
2026-03-28 18:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b066b10>
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_a7aca0729cf858a23678b41323cc1fa2.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_a7aca0729cf858a23678b41323cc1fa2.jpg saved to cache
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c9790>
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_4da4908d78a809de8234919da94c2e7c.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_4da4908d78a809de8234919da94c2e7c.jpg saved to cache
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_32fd853debc61edee4502211ca9d09a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:55 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-28 18:38:55 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [auto1.de] INFO: Scrape type for GA49917: 2
2026-03-28 18:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c905584c-9be7-54f0-9c47-979d0256b153 with identifier: GA49917
2026-03-28 18:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c905584c-9be7-54f0-9c47-979d0256b153 with scrape type 2
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c905584c-9be7-54f0-9c47-979d0256b153 with scrape type 2
2026-03-28 18:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c905584c-9be7-54f0-9c47-979d0256b153, identifier: GA49917
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_ba2d440bcd3b9ef164f6d4458c77cf1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_ba2d440bcd3b9ef164f6d4458c77cf1d.jpg not downloaded yet
2026-03-28 18:38:55 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [auto1.de] INFO: Scrape type for LT01381: 1
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_07a985ad2c2565b2dceb96c925d29469.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_07a985ad2c2565b2dceb96c925d29469.jpg not downloaded yet
2026-03-28 18:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c905584c-9be7-54f0-9c47-979d0256b153 with identifier: GA49917
2026-03-28 18:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c905584c-9be7-54f0-9c47-979d0256b153 with identifier: GA49917
2026-03-28 18:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c905584c-9be7-54f0-9c47-979d0256b153 with identifier: GA49917 to the API
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:36:24Z',
 'fuel_type': 'petrol',
 'id': 'c905584c-9be7-54f0-9c47-979d0256b153',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA49917',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 100944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-21',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2014}
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA49917%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [auto1.de] INFO: Saving data for GA49917: {'auction_closing_time': 1774884984.0, 'created_time': 1774034319.618263, 'last_price_update_time': 1774723135.751921}
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA49917') HTTP/1.1" 204 0
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_5f73a68ad745f21039ccf68363593e66.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_5f73a68ad745f21039ccf68363593e66.jpg not downloaded yet
2026-03-28 18:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with identifier: TP61394
2026-03-28 18:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with scrape type 1
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_f3598c5ecbc63703eab4e63d1e2cd131.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_f3598c5ecbc63703eab4e63d1e2cd131.jpg not downloaded yet
2026-03-28 18:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_92876aa53e9ca8e6807bcbddf1ba6abc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:55 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [auto1.de] INFO: Scrape type for CC10989: 1
2026-03-28 18:38:55 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [auto1.de] INFO: Scrape type for ZX19467: 1
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_336778a81acaa0f911965ed03bee110c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_336778a81acaa0f911965ed03bee110c.jpg not downloaded yet
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0ff50>
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_177c00481cab5331d78e3f7bbd6baf19.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_177c00481cab5331d78e3f7bbd6baf19.jpg saved to cache
2026-03-28 18:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 392ce6f0-1e5b-5695-8f94-a24c39110444
2026-03-28 18:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_5ad17c0bb863fdebf7b4ada0eba50c8b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_41490b2b52debc9ea7334f476830fa70.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_41490b2b52debc9ea7334f476830fa70.jpg not downloaded yet
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_39a7711746b871a2954215e19a28c8aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_39a7711746b871a2954215e19a28c8aa.jpg not downloaded yet
2026-03-28 18:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ72548/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd8b0d0>
2026-03-28 18:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_32fd853debc61edee4502211ca9d09a3.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_32fd853debc61edee4502211ca9d09a3.jpg saved to cache
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_24ec9766287807447b3490ce48a59315.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Scrape type for MP53713: 2
2026-03-28 18:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with identifier: MP53713
2026-03-28 18:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with scrape type 2
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with scrape type 2
2026-03-28 18:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09, identifier: MP53713
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-28 18:38:56 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Scrape type for BC54503: 2
2026-03-28 18:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81c07080-90bd-522c-ae92-4bf5d8519092 with identifier: BC54503
2026-03-28 18:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81c07080-90bd-522c-ae92-4bf5d8519092 with scrape type 2
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81c07080-90bd-522c-ae92-4bf5d8519092 with scrape type 2
2026-03-28 18:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81c07080-90bd-522c-ae92-4bf5d8519092, identifier: BC54503
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_f103aea241a55727792ad8d3d09bdb3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_f103aea241a55727792ad8d3d09bdb3f.jpg not downloaded yet
2026-03-28 18:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with identifier: MP53713
2026-03-28 18:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with identifier: MP53713
2026-03-28 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8eda5a79-01a3-5c33-8a29-cfd6cd137e09 with identifier: MP53713 to the API
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:03:54Z',
 'fuel_type': 'petrol',
 'id': '8eda5a79-01a3-5c33-8a29-cfd6cd137e09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP53713',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 120517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-15',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP53713%27 HTTP/1.1" 200 None
2026-03-28 18:38:56 [auto1.de] INFO: Saving data for MP53713: {'auction_closing_time': 1774883034.0, 'created_time': 1774349847.094026, 'last_price_update_time': 1774723136.665037}
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP53713') HTTP/1.1" 204 0
2026-03-28 18:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81c07080-90bd-522c-ae92-4bf5d8519092 with identifier: BC54503
2026-03-28 18:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81c07080-90bd-522c-ae92-4bf5d8519092 with identifier: BC54503
2026-03-28 18:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81c07080-90bd-522c-ae92-4bf5d8519092 with identifier: BC54503 to the API
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-30T15:26:44Z',
 'fuel_type': 'petrol',
 'id': '81c07080-90bd-522c-ae92-4bf5d8519092',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC54503',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 79633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 63 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-28 18:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC54503%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Saving data for BC54503: {'auction_closing_time': 1774884404.0, 'created_time': 1774349626.958854, 'last_price_update_time': 1774723137.005663}
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC54503') HTTP/1.1" 204 0
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_ce7dd765d211026caaa62cece785c007.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_ce7dd765d211026caaa62cece785c007.jpg not downloaded yet
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_afe9b192e4dac391de14468d1f9d234f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_afe9b192e4dac391de14468d1f9d234f.jpg not downloaded yet
2026-03-28 18:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK21790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for YA63127: 2
2026-03-28 18:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with identifier: YA63127
2026-03-28 18:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with scrape type 2
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with scrape type 2
2026-03-28 18:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae65f7a0-750f-5818-a02a-e8b1d41fbb67, identifier: YA63127
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for YR75150: 1
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b104710>
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_92876aa53e9ca8e6807bcbddf1ba6abc.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_92876aa53e9ca8e6807bcbddf1ba6abc.jpg saved to cache
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 392ce6f0-1e5b-5695-8f94-a24c39110444
2026-03-28 18:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_b899a5f688028251cc677fa875260b5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_602aa21aa6ce612d49dc40c05127af9b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_b16bfacbd5198042bc3b89e6a722bb34.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with identifier: YA63127
2026-03-28 18:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with identifier: YA63127
2026-03-28 18:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae65f7a0-750f-5818-a02a-e8b1d41fbb67 with identifier: YA63127 to the API
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:20:34Z',
 'fuel_type': 'petrol',
 'id': 'ae65f7a0-750f-5818-a02a-e8b1d41fbb67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA63127',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 167272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-05',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Best of',
 'transmission': 'manual',
 'trim': 'Best of',
 'year': 2009}
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA63127%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Saving data for YA63127: {'auction_closing_time': 1774884034.0, 'created_time': 1773468426.08751, 'last_price_update_time': 1774723137.582424}
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA63127') HTTP/1.1" 204 0
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_7e6bc4b74d9b3d8426a47c69ac46e48d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_7e6bc4b74d9b3d8426a47c69ac46e48d.jpg not downloaded yet
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_9d6f67ca775234929ababe756c2c10b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_9d6f67ca775234929ababe756c2c10b0.jpg not downloaded yet
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for WK48382: 2
2026-03-28 18:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c914e6e-551b-5156-a1a0-2f722acde46b with identifier: WK48382
2026-03-28 18:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c914e6e-551b-5156-a1a0-2f722acde46b with scrape type 2
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c914e6e-551b-5156-a1a0-2f722acde46b with scrape type 2
2026-03-28 18:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c914e6e-551b-5156-a1a0-2f722acde46b, identifier: WK48382
2026-03-28 18:38:57 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-28 18:38:57 [auto1.de] INFO: Scrape type for TP97389: 1
2026-03-28 18:38:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b2b10>
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_5ad17c0bb863fdebf7b4ada0eba50c8b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_5ad17c0bb863fdebf7b4ada0eba50c8b.jpg saved to cache
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb82d0>
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_24ec9766287807447b3490ce48a59315.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_24ec9766287807447b3490ce48a59315.jpg saved to cache
2026-03-28 18:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c914e6e-551b-5156-a1a0-2f722acde46b with identifier: WK48382
2026-03-28 18:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c914e6e-551b-5156-a1a0-2f722acde46b with identifier: WK48382
2026-03-28 18:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c914e6e-551b-5156-a1a0-2f722acde46b with identifier: WK48382 to the API
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:31Z',
 'fuel_type': 'petrol',
 'id': '6c914e6e-551b-5156-a1a0-2f722acde46b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK48382',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 114010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.6 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK48382%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Saving data for WK48382: {'auction_closing_time': 1774885711.0, 'created_time': 1774032265.601091, 'last_price_update_time': 1774723138.321337}
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK48382') HTTP/1.1" 204 0
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_e77647c2fac5500bf7759d7cb75335ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_e77647c2fac5500bf7759d7cb75335ca.jpg not downloaded yet
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_e6f6f5394f30d9a974259caaecb604ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_e6f6f5394f30d9a974259caaecb604ba.jpg not downloaded yet
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for AN23805: 2
2026-03-28 18:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5683f740-4a0f-5859-978a-0a45bc7bc823 with identifier: AN23805
2026-03-28 18:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5683f740-4a0f-5859-978a-0a45bc7bc823 with scrape type 2
2026-03-28 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5683f740-4a0f-5859-978a-0a45bc7bc823 with scrape type 2
2026-03-28 18:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5683f740-4a0f-5859-978a-0a45bc7bc823, identifier: AN23805
2026-03-28 18:38:58 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Scrape type for EC10607: 2
2026-03-28 18:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with identifier: EC10607
2026-03-28 18:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with scrape type 2
2026-03-28 18:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with scrape type 2
2026-03-28 18:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac, identifier: EC10607
2026-03-28 18:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS73315> (referer: https://www.auto1.com/v1/car-details-view/CS73315/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5683f740-4a0f-5859-978a-0a45bc7bc823 with identifier: AN23805
2026-03-28 18:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5683f740-4a0f-5859-978a-0a45bc7bc823 with identifier: AN23805
2026-03-28 18:38:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5683f740-4a0f-5859-978a-0a45bc7bc823 with identifier: AN23805 to the API
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:56:44Z',
 'fuel_type': 'petrol',
 'id': '5683f740-4a0f-5859-978a-0a45bc7bc823',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN23805',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 32093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-03',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Mild-Hybrid ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN23805%27 HTTP/1.1" 200 None
2026-03-28 18:38:58 [auto1.de] INFO: Saving data for AN23805: {'auction_closing_time': 1774886204.0, 'created_time': 1774002418.362973, 'last_price_update_time': 1774723138.938382}
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN23805') HTTP/1.1" 204 0
2026-03-28 18:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with identifier: EC10607
2026-03-28 18:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with identifier: EC10607
2026-03-28 18:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ef9c13f-7e8c-58eb-a2b0-748fc39963ac with identifier: EC10607 to the API
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:13:30Z',
 'fuel_type': 'petrol',
 'id': '3ef9c13f-7e8c-58eb-a2b0-748fc39963ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC10607',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 170917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-06',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.8 V6 Turbo OPC 4x4',
 'transmission': 'automatic',
 'trim': 'OPC 4x4',
 'year': 2015}
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC10607%27 HTTP/1.1" 200 None
2026-03-28 18:38:59 [auto1.de] INFO: Saving data for EC10607: {'auction_closing_time': 1774883610.0, 'created_time': 1774034210.665272, 'last_price_update_time': 1774723139.276413}
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC10607') HTTP/1.1" 204 0
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_77ffc136148c1c63e5178335aadd627c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_77ffc136148c1c63e5178335aadd627c.jpg not downloaded yet
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7b490>
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_b899a5f688028251cc677fa875260b5a.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_b899a5f688028251cc677fa875260b5a.jpg saved to cache
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 392ce6f0-1e5b-5695-8f94-a24c39110444
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb9110>
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_602aa21aa6ce612d49dc40c05127af9b.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_602aa21aa6ce612d49dc40c05127af9b.jpg saved to cache
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b235d50>
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:38:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_b16bfacbd5198042bc3b89e6a722bb34.jpg') HTTP/1.1" 204 0
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_b16bfacbd5198042bc3b89e6a722bb34.jpg saved to cache
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_5832a7b282860fea05c824772458a2b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_f3598c5ecbc63703eab4e63d1e2cd131.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_07a985ad2c2565b2dceb96c925d29469.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_7911dc32994eb2944845712b0b39f50f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:59 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-28 18:38:59 [auto1.de] INFO: Scrape type for VL97674: 1
2026-03-28 18:38:59 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-28 18:38:59 [auto1.de] INFO: Scrape type for LE99206: 1
2026-03-28 18:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_0739a639e18216c82634fe0cd3bf6c58.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:38:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ69536> (referer: https://www.auto1.com/v1/car-details-view/HZ69536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:38:59 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-28 18:38:59 [auto1.de] INFO: Scrape type for UT78656: 2
2026-03-28 18:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b714401e-9962-5387-8e81-7592c2f2aa1b with identifier: UT78656
2026-03-28 18:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b714401e-9962-5387-8e81-7592c2f2aa1b with scrape type 2
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b714401e-9962-5387-8e81-7592c2f2aa1b with scrape type 2
2026-03-28 18:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b714401e-9962-5387-8e81-7592c2f2aa1b, identifier: UT78656
2026-03-28 18:38:59 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-28 18:38:59 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-28 18:38:59 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-28 18:38:59 [auto1.de] INFO: Scrape type for PH13735: 2
2026-03-28 18:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 428508bb-e434-5f60-8e59-c2789ab3a1ab with identifier: PH13735
2026-03-28 18:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 428508bb-e434-5f60-8e59-c2789ab3a1ab with scrape type 2
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 428508bb-e434-5f60-8e59-c2789ab3a1ab with scrape type 2
2026-03-28 18:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 428508bb-e434-5f60-8e59-c2789ab3a1ab, identifier: PH13735
2026-03-28 18:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a1fb31d-c361-5370-b026-e914fc16190f with identifier: CS73315
2026-03-28 18:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a1fb31d-c361-5370-b026-e914fc16190f with scrape type 1
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_8ecd5da5fce5d04a46102402efba7408.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_8ecd5da5fce5d04a46102402efba7408.jpg not downloaded yet
2026-03-28 18:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b714401e-9962-5387-8e81-7592c2f2aa1b with identifier: UT78656
2026-03-28 18:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b714401e-9962-5387-8e81-7592c2f2aa1b with identifier: UT78656
2026-03-28 18:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b714401e-9962-5387-8e81-7592c2f2aa1b with identifier: UT78656 to the API
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:37:24Z',
 'fuel_type': 'diesel',
 'id': 'b714401e-9962-5387-8e81-7592c2f2aa1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT78656',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 149353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-23',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2016}
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT78656%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Saving data for UT78656: {'auction_closing_time': 1774885044.0, 'created_time': 1774033870.139506, 'last_price_update_time': 1774723140.061352}
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT78656') HTTP/1.1" 204 0
2026-03-28 18:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 428508bb-e434-5f60-8e59-c2789ab3a1ab with identifier: PH13735
2026-03-28 18:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 428508bb-e434-5f60-8e59-c2789ab3a1ab with identifier: PH13735
2026-03-28 18:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 428508bb-e434-5f60-8e59-c2789ab3a1ab with identifier: PH13735 to the API
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:34:29Z',
 'fuel_type': 'diesel',
 'id': '428508bb-e434-5f60-8e59-c2789ab3a1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH13735',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 145505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-16',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2013}
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH13735%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Saving data for PH13735: {'auction_closing_time': 1774884869.0, 'created_time': 1774349152.781916, 'last_price_update_time': 1774723140.538275}
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH13735') HTTP/1.1" 204 0
2026-03-28 18:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_d15f46c47dcda0cce85b796fbf456057.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for RT81127: 2
2026-03-28 18:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41602036-a196-58ac-a10a-b835e715b5c2 with identifier: RT81127
2026-03-28 18:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41602036-a196-58ac-a10a-b835e715b5c2 with scrape type 2
2026-03-28 18:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41602036-a196-58ac-a10a-b835e715b5c2 with scrape type 2
2026-03-28 18:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41602036-a196-58ac-a10a-b835e715b5c2, identifier: RT81127
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-28 18:39:00 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [auto1.de] INFO: Scrape type for CY46145: 1
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_dc4b455e1802636b7f205d1fe1c489e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_dc4b455e1802636b7f205d1fe1c489e5.jpg not downloaded yet
2026-03-28 18:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_e6f6f5394f30d9a974259caaecb604ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_f103aea241a55727792ad8d3d09bdb3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_ce7dd765d211026caaa62cece785c007.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_afe9b192e4dac391de14468d1f9d234f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41602036-a196-58ac-a10a-b835e715b5c2 with identifier: RT81127
2026-03-28 18:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41602036-a196-58ac-a10a-b835e715b5c2 with identifier: RT81127
2026-03-28 18:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41602036-a196-58ac-a10a-b835e715b5c2 with identifier: RT81127 to the API
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:28Z',
 'fuel_type': 'petrol',
 'id': '41602036-a196-58ac-a10a-b835e715b5c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT81127',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 28327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2022}
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT81127%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [auto1.de] INFO: Saving data for RT81127: {'auction_closing_time': 1774883608.0, 'created_time': 1774118462.290301, 'last_price_update_time': 1774723141.086955}
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT81127') HTTP/1.1" 204 0
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [auto1.de] INFO: Scrape type for NC58057: 1
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_470955e97c2c33a14155098a8776e1be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_470955e97c2c33a14155098a8776e1be.jpg not downloaded yet
2026-03-28 18:39:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0355d0>
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_5832a7b282860fea05c824772458a2b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_5832a7b282860fea05c824772458a2b2.jpg saved to cache
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcf290>
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_f3598c5ecbc63703eab4e63d1e2cd131.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_f3598c5ecbc63703eab4e63d1e2cd131.jpg saved to cache
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b1b90>
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_07a985ad2c2565b2dceb96c925d29469.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_07a985ad2c2565b2dceb96c925d29469.jpg saved to cache
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b161350>
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_7911dc32994eb2944845712b0b39f50f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_7911dc32994eb2944845712b0b39f50f.jpg saved to cache
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 392ce6f0-1e5b-5695-8f94-a24c39110444
2026-03-28 18:39:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b3710>
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_0739a639e18216c82634fe0cd3bf6c58.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_0739a639e18216c82634fe0cd3bf6c58.jpg saved to cache
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e89d4248-00c8-503d-9396-b1e2a70aac31 with identifier: HZ69536
2026-03-28 18:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89d4248-00c8-503d-9396-b1e2a70aac31 with scrape type 1
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e89d4248-00c8-503d-9396-b1e2a70aac31
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_2c38061a6d44c6ba34704e85773686fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_2c38061a6d44c6ba34704e85773686fe.jpg not downloaded yet
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-28 18:39:01 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [auto1.de] INFO: Scrape type for TF03370: 2
2026-03-28 18:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4312e30-df26-5dbf-99de-c14e960b5fc2 with identifier: TF03370
2026-03-28 18:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4312e30-df26-5dbf-99de-c14e960b5fc2 with scrape type 2
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4312e30-df26-5dbf-99de-c14e960b5fc2 with scrape type 2
2026-03-28 18:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4312e30-df26-5dbf-99de-c14e960b5fc2, identifier: TF03370
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_41d2e1089b6e20e7674347f010a5c923.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_41d2e1089b6e20e7674347f010a5c923.jpg not downloaded yet
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_7ffea0f63eaf2df965a5186b0416dd2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_7ffea0f63eaf2df965a5186b0416dd2a.jpg not downloaded yet
2026-03-28 18:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4312e30-df26-5dbf-99de-c14e960b5fc2 with identifier: TF03370
2026-03-28 18:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4312e30-df26-5dbf-99de-c14e960b5fc2 with identifier: TF03370
2026-03-28 18:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4312e30-df26-5dbf-99de-c14e960b5fc2 with identifier: TF03370 to the API
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:12:01Z',
 'fuel_type': 'petrol',
 'id': 'a4312e30-df26-5dbf-99de-c14e960b5fc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF03370',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 138435,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-04',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF03370%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Saving data for TF03370: {'auction_closing_time': 1774883521.0, 'created_time': 1774089260.114088, 'last_price_update_time': 1774723142.101518}
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF03370') HTTP/1.1" 204 0
2026-03-28 18:39:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b020410>
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_d15f46c47dcda0cce85b796fbf456057.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_d15f46c47dcda0cce85b796fbf456057.jpg saved to cache
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd36c50>
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_e6f6f5394f30d9a974259caaecb604ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_e6f6f5394f30d9a974259caaecb604ba.jpg saved to cache
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b070a10>
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_f103aea241a55727792ad8d3d09bdb3f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_f103aea241a55727792ad8d3d09bdb3f.jpg saved to cache
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b299190>
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_ce7dd765d211026caaa62cece785c007.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_ce7dd765d211026caaa62cece785c007.jpg saved to cache
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb02d50>
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_afe9b192e4dac391de14468d1f9d234f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_afe9b192e4dac391de14468d1f9d234f.jpg saved to cache
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Scrape type for FF37262: 2
2026-03-28 18:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69123462-e44f-57c2-9892-304418727428 with identifier: FF37262
2026-03-28 18:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69123462-e44f-57c2-9892-304418727428 with scrape type 2
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69123462-e44f-57c2-9892-304418727428 with scrape type 2
2026-03-28 18:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69123462-e44f-57c2-9892-304418727428, identifier: FF37262
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_d2ca664d10a98f8583988f9b84bc3e99.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_d2ca664d10a98f8583988f9b84bc3e99.jpg not downloaded yet
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_2582f7ee2b44fe3e4d3facb182b0d421.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_2582f7ee2b44fe3e4d3facb182b0d421.jpg not downloaded yet
2026-03-28 18:39:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_5e6d3c953194d50b9139c131ec2dec42.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_9d6f67ca775234929ababe756c2c10b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69123462-e44f-57c2-9892-304418727428 with identifier: FF37262
2026-03-28 18:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69123462-e44f-57c2-9892-304418727428 with identifier: FF37262
2026-03-28 18:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69123462-e44f-57c2-9892-304418727428 with identifier: FF37262 to the API
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:47Z',
 'fuel_type': 'diesel',
 'id': '69123462-e44f-57c2-9892-304418727428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF37262',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 242728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Audi Q3 35 TDI Advanced',
 'transmission': 'automatic',
 'trim': 'Advanced',
 'year': 2020}
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF37262%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Saving data for FF37262: {'auction_closing_time': 1774884167.0, 'created_time': 1773467615.460534, 'last_price_update_time': 1774723142.892425}
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF37262') HTTP/1.1" 204 0
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Scrape type for UL28707: 1
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_948301bafec358ce8296aaef0ea1e77d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_948301bafec358ce8296aaef0ea1e77d.jpg not downloaded yet
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_c12dd19868ca1ef4564a117a1ffce763.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_c12dd19868ca1ef4564a117a1ffce763.jpg not downloaded yet
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-28 18:39:02 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [auto1.de] INFO: Scrape type for FR17679: 1
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_ea16a79a90f8d1873dbed9de84ecb1d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_ea16a79a90f8d1873dbed9de84ecb1d9.jpg not downloaded yet
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_4768b0df8f4edd711f325b34cda4c5a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_4768b0df8f4edd711f325b34cda4c5a5.jpg not downloaded yet
2026-03-28 18:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ72548> (referer: https://www.auto1.com/v1/car-details-view/SJ72548/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YR75150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TP97389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb20950>
2026-03-28 18:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_5e6d3c953194d50b9139c131ec2dec42.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_5e6d3c953194d50b9139c131ec2dec42.jpg saved to cache
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:39:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b245910>
2026-03-28 18:39:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_9d6f67ca775234929ababe756c2c10b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_9d6f67ca775234929ababe756c2c10b0.jpg saved to cache
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595
2026-03-28 18:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_2c38061a6d44c6ba34704e85773686fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_dc4b455e1802636b7f205d1fe1c489e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_470955e97c2c33a14155098a8776e1be.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for XG50299: 2
2026-03-28 18:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e68cb3-820c-594d-9249-2b401bfad698 with identifier: XG50299
2026-03-28 18:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e68cb3-820c-594d-9249-2b401bfad698 with scrape type 2
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e68cb3-820c-594d-9249-2b401bfad698 with scrape type 2
2026-03-28 18:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3e68cb3-820c-594d-9249-2b401bfad698, identifier: XG50299
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_0a9b59a68fac7de6d66850cc74eab52d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_0a9b59a68fac7de6d66850cc74eab52d.jpg not downloaded yet
2026-03-28 18:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_41d2e1089b6e20e7674347f010a5c923.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3e68cb3-820c-594d-9249-2b401bfad698 with identifier: XG50299
2026-03-28 18:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3e68cb3-820c-594d-9249-2b401bfad698 with identifier: XG50299
2026-03-28 18:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3e68cb3-820c-594d-9249-2b401bfad698 with identifier: XG50299 to the API
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:24:45Z',
 'fuel_type': 'diesel',
 'id': 'b3e68cb3-820c-594d-9249-2b401bfad698',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG50299',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 114863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-13',
 'seller_name': None,
 'title': 'Audi A7 Sportback 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG50299%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Saving data for XG50299: {'auction_closing_time': 1774884285.0, 'created_time': 1773468492.104845, 'last_price_update_time': 1774723143.63084}
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG50299') HTTP/1.1" 204 0
2026-03-28 18:39:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_7ffea0f63eaf2df965a5186b0416dd2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-28 18:39:03 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [auto1.de] INFO: Scrape type for VR85555: 2
2026-03-28 18:39:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6bca207-63b8-554a-8933-8b1bfba7fd39 with identifier: VR85555
2026-03-28 18:39:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6bca207-63b8-554a-8933-8b1bfba7fd39 with scrape type 2
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6bca207-63b8-554a-8933-8b1bfba7fd39 with scrape type 2
2026-03-28 18:39:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6bca207-63b8-554a-8933-8b1bfba7fd39, identifier: VR85555
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_b15f7d03055050021e11dde5ca4fdce1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_b15f7d03055050021e11dde5ca4fdce1.jpg not downloaded yet
2026-03-28 18:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6bca207-63b8-554a-8933-8b1bfba7fd39 with identifier: VR85555
2026-03-28 18:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6bca207-63b8-554a-8933-8b1bfba7fd39 with identifier: VR85555
2026-03-28 18:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6bca207-63b8-554a-8933-8b1bfba7fd39 with identifier: VR85555 to the API
2026-03-28 18:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:08:03Z',
 'fuel_type': 'diesel',
 'id': 'e6bca207-63b8-554a-8933-8b1bfba7fd39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR85555',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 95347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-20',
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85555%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Saving data for VR85555: {'auction_closing_time': 1774883283.0, 'created_time': 1773467938.208149, 'last_price_update_time': 1774723144.213813}
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR85555') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with identifier: SJ72548
2026-03-28 18:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with scrape type 1
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_a42e5515fa283d313e2891350b4abd77.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a42e5515fa283d313e2891350b4abd77.jpg not downloaded yet
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbfba50>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_2c38061a6d44c6ba34704e85773686fe.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_2c38061a6d44c6ba34704e85773686fe.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e89d4248-00c8-503d-9396-b1e2a70aac31
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c55d0>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_dc4b455e1802636b7f205d1fe1c489e5.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_dc4b455e1802636b7f205d1fe1c489e5.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26d6d0>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_470955e97c2c33a14155098a8776e1be.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_470955e97c2c33a14155098a8776e1be.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_d2ca664d10a98f8583988f9b84bc3e99.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Scrape type for VB32886: 1
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_4f4e8cee12b0506de037c52d3d9d99b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_4f4e8cee12b0506de037c52d3d9d99b0.jpg not downloaded yet
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_c12dd19868ca1ef4564a117a1ffce763.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_948301bafec358ce8296aaef0ea1e77d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_d2731338cfb2796fbf85c12f225cddb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_d2731338cfb2796fbf85c12f225cddb0.jpg not downloaded yet
2026-03-28 18:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b066850>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_41d2e1089b6e20e7674347f010a5c923.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_41d2e1089b6e20e7674347f010a5c923.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b06c210>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_7ffea0f63eaf2df965a5186b0416dd2a.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_7ffea0f63eaf2df965a5186b0416dd2a.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e89d4248-00c8-503d-9396-b1e2a70aac31
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_35f37f987890f6ecc204de39a2107c3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_2582f7ee2b44fe3e4d3facb182b0d421.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_4768b0df8f4edd711f325b34cda4c5a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [auto1.de] INFO: Scrape type for DC55349: 1
2026-03-28 18:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_f1488b2be1a6adee0f42a0b0cc7a1896.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_f1488b2be1a6adee0f42a0b0cc7a1896.jpg not downloaded yet
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY46145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:04 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-28 18:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb00e50>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_d2ca664d10a98f8583988f9b84bc3e99.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_d2ca664d10a98f8583988f9b84bc3e99.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b041350>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_c12dd19868ca1ef4564a117a1ffce763.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_c12dd19868ca1ef4564a117a1ffce763.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e89d4248-00c8-503d-9396-b1e2a70aac31
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_8ecd5da5fce5d04a46102402efba7408.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_ea16a79a90f8d1873dbed9de84ecb1d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_38b8d1638898b036b8e5f5bc74224df1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_38b8d1638898b036b8e5f5bc74224df1.jpg not downloaded yet
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2ed950>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_948301bafec358ce8296aaef0ea1e77d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_948301bafec358ce8296aaef0ea1e77d.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a42e5515fa283d313e2891350b4abd77.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_b15f7d03055050021e11dde5ca4fdce1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_0a9b59a68fac7de6d66850cc74eab52d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_59eb503d56d72508655ee13d44f7155e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_59eb503d56d72508655ee13d44f7155e.jpg not downloaded yet
2026-03-28 18:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC58057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b077e50>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_35f37f987890f6ecc204de39a2107c3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_35f37f987890f6ecc204de39a2107c3d.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0668d0>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_2582f7ee2b44fe3e4d3facb182b0d421.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_2582f7ee2b44fe3e4d3facb182b0d421.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e89d4248-00c8-503d-9396-b1e2a70aac31
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b234650>
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0e%252Fe0%252F0ee0775c2649988d7d81a74db4f34821%252Fpa%252FHZ69536_4768b0df8f4edd711f325b34cda4c5a5.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_4768b0df8f4edd711f325b34cda4c5a5.jpg saved to cache
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e89d4248-00c8-503d-9396-b1e2a70aac31
2026-03-28 18:39:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e89d4248-00c8-503d-9396-b1e2a70aac31, skipping ID generation
2026-03-28 18:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e89d4248-00c8-503d-9396-b1e2a70aac31 with scrape type 1
2026-03-28 18:39:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e89d4248-00c8-503d-9396-b1e2a70aac31 sending to next pipeline
2026-03-28 18:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e89d4248-00c8-503d-9396-b1e2a70aac31, identifier: HZ69536
2026-03-28 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_4f4e8cee12b0506de037c52d3d9d99b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e89d4248-00c8-503d-9396-b1e2a70aac31 with identifier: HZ69536
2026-03-28 18:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e89d4248-00c8-503d-9396-b1e2a70aac31 with identifier: HZ69536
2026-03-28 18:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e89d4248-00c8-503d-9396-b1e2a70aac31 with identifier: HZ69536 to the API
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_4768b0df8f4edd711f325b34cda4c5a5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:36:08Z',
 'fuel_type': 'petrol',
 'id': 'e89d4248-00c8-503d-9396-b1e2a70aac31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ69536',
 'listing': 'auction',
 'location': 'DE, Kaiserslautern',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 170985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_2c38061a6d44c6ba34704e85773686fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_7ffea0f63eaf2df965a5186b0416dd2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_2582f7ee2b44fe3e4d3facb182b0d421.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_c12dd19868ca1ef4564a117a1ffce763.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e89d4248-00c8-503d-9396-b1e2a70aac31/e89d4248-00c8-503d-9396-b1e2a70aac31_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0e/e0/0ee0775c2649988d7d81a74db4f34821/pa/HZ69536_4768b0df8f4edd711f325b34cda4c5a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ69536%27 HTTP/1.1" 200 None
2026-03-28 18:39:05 [auto1.de] INFO: Saving data for HZ69536: {'created_time': 1774723145.480488, 'last_price_update_time': 1774723145.480501, 'auction_closing_time': 1774884968.0}
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ69536') HTTP/1.1" 204 0
2026-03-28 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_d2731338cfb2796fbf85c12f225cddb0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_69cfae567892cdf5af309f38419acba1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_69cfae567892cdf5af309f38419acba1.jpg not downloaded yet
2026-03-28 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_f1488b2be1a6adee0f42a0b0cc7a1896.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR17679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b207250>
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_8ecd5da5fce5d04a46102402efba7408.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_8ecd5da5fce5d04a46102402efba7408.jpg saved to cache
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd4f9d0>
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_ea16a79a90f8d1873dbed9de84ecb1d9.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_ea16a79a90f8d1873dbed9de84ecb1d9.jpg saved to cache
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2aa010>
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_a42e5515fa283d313e2891350b4abd77.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a42e5515fa283d313e2891350b4abd77.jpg saved to cache
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c0ad0>
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_b15f7d03055050021e11dde5ca4fdce1.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_b15f7d03055050021e11dde5ca4fdce1.jpg saved to cache
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b03fc10>
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_0a9b59a68fac7de6d66850cc74eab52d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_0a9b59a68fac7de6d66850cc74eab52d.jpg saved to cache
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_75d58d4492ad7a7751c90eaee31b01c5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_75d58d4492ad7a7751c90eaee31b01c5.jpg not downloaded yet
2026-03-28 18:39:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_38b8d1638898b036b8e5f5bc74224df1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_77ffc136148c1c63e5178335aadd627c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26ec50>
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fd3%252F88d3dfaace7a12b6794f198574c7e058%252Fpa%252FCS73315_4f4e8cee12b0506de037c52d3d9d99b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_4f4e8cee12b0506de037c52d3d9d99b0.jpg saved to cache
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a1fb31d-c361-5370-b026-e914fc16190f
2026-03-28 18:39:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a1fb31d-c361-5370-b026-e914fc16190f, skipping ID generation
2026-03-28 18:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a1fb31d-c361-5370-b026-e914fc16190f with scrape type 1
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a1fb31d-c361-5370-b026-e914fc16190f sending to next pipeline
2026-03-28 18:39:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a1fb31d-c361-5370-b026-e914fc16190f, identifier: CS73315
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_a35dee5ec4b6e690d34d8ccb681600ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a35dee5ec4b6e690d34d8ccb681600ad.jpg not downloaded yet
2026-03-28 18:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a1fb31d-c361-5370-b026-e914fc16190f with identifier: CS73315
2026-03-28 18:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a1fb31d-c361-5370-b026-e914fc16190f with identifier: CS73315
2026-03-28 18:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a1fb31d-c361-5370-b026-e914fc16190f with identifier: CS73315 to the API
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_4f4e8cee12b0506de037c52d3d9d99b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:37Z',
 'fuel_type': 'diesel',
 'id': '8a1fb31d-c361-5370-b026-e914fc16190f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS73315',
 'listing': 'auction',
 'location': 'DE, Fockbek',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 126542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_8ecd5da5fce5d04a46102402efba7408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_dc4b455e1802636b7f205d1fe1c489e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_470955e97c2c33a14155098a8776e1be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_41d2e1089b6e20e7674347f010a5c923.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_d2ca664d10a98f8583988f9b84bc3e99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_948301bafec358ce8296aaef0ea1e77d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_ea16a79a90f8d1873dbed9de84ecb1d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_0a9b59a68fac7de6d66850cc74eab52d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_b15f7d03055050021e11dde5ca4fdce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8a1fb31d-c361-5370-b026-e914fc16190f/8a1fb31d-c361-5370-b026-e914fc16190f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63114,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/d3/88d3dfaace7a12b6794f198574c7e058/pa/CS73315_4f4e8cee12b0506de037c52d3d9d99b0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2018}
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS73315%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [auto1.de] INFO: Saving data for CS73315: {'created_time': 1774723146.290855, 'last_price_update_time': 1774723146.290865, 'auction_closing_time': 1774885777.0}
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS73315') HTTP/1.1" 204 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_a3c478264ab7ddbbd5b815e6f026cff8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a3c478264ab7ddbbd5b815e6f026cff8.jpg not downloaded yet
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26f9d0>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_d2731338cfb2796fbf85c12f225cddb0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_d2731338cfb2796fbf85c12f225cddb0.jpg saved to cache
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0ec90>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_f1488b2be1a6adee0f42a0b0cc7a1896.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_f1488b2be1a6adee0f42a0b0cc7a1896.jpg saved to cache
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10b010>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_38b8d1638898b036b8e5f5bc74224df1.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_38b8d1638898b036b8e5f5bc74224df1.jpg saved to cache
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd7b690>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_77ffc136148c1c63e5178335aadd627c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_77ffc136148c1c63e5178335aadd627c.jpg saved to cache
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_59eb503d56d72508655ee13d44f7155e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UL28707/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB32886/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_50cdd239c08147e82efa074887c65693.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_50cdd239c08147e82efa074887c65693.jpg not downloaded yet
2026-03-28 18:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_69cfae567892cdf5af309f38419acba1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TP97389> (referer: https://www.auto1.com/v1/car-details-view/TP97389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC55349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_336778a81acaa0f911965ed03bee110c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_e77647c2fac5500bf7759d7cb75335ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_7e6bc4b74d9b3d8426a47c69ac46e48d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8f350>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_59eb503d56d72508655ee13d44f7155e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_59eb503d56d72508655ee13d44f7155e.jpg saved to cache
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a3c478264ab7ddbbd5b815e6f026cff8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a35dee5ec4b6e690d34d8ccb681600ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd6910>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_69cfae567892cdf5af309f38419acba1.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_69cfae567892cdf5af309f38419acba1.jpg saved to cache
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with identifier: TP97389
2026-03-28 18:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with scrape type 1
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_4f8e2a20bee8e0b60f34d4ccaf3f3d1f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_4f8e2a20bee8e0b60f34d4ccaf3f3d1f.jpg not downloaded yet
2026-03-28 18:39:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b001110>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_336778a81acaa0f911965ed03bee110c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_336778a81acaa0f911965ed03bee110c.jpg saved to cache
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_75d58d4492ad7a7751c90eaee31b01c5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX19467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_50cdd239c08147e82efa074887c65693.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_ecdeda81c15bad95a0f5f92fbb2b26e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_ecdeda81c15bad95a0f5f92fbb2b26e4.jpg not downloaded yet
2026-03-28 18:39:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d58250>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_e77647c2fac5500bf7759d7cb75335ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_e77647c2fac5500bf7759d7cb75335ca.jpg saved to cache
2026-03-28 18:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:39:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7b610>
2026-03-28 18:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_7e6bc4b74d9b3d8426a47c69ac46e48d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_7e6bc4b74d9b3d8426a47c69ac46e48d.jpg saved to cache
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:39:07 [scrapy.extensions.logstats] INFO: Crawled 283 pages (at 91 pages/min), scraped 535 items (at 69 items/min)
2026-03-28 18:39:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-28 18:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YR75150> (referer: https://www.auto1.com/v1/car-details-view/YR75150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_40a6133d3fe8c6fbd839e529c8a885c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_40a6133d3fe8c6fbd839e529c8a885c2.jpg not downloaded yet
2026-03-28 18:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b102e50>
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_a3c478264ab7ddbbd5b815e6f026cff8.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a3c478264ab7ddbbd5b815e6f026cff8.jpg saved to cache
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a0ae8d0>
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_a35dee5ec4b6e690d34d8ccb681600ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a35dee5ec4b6e690d34d8ccb681600ad.jpg saved to cache
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE99206/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b06cf90>
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_75d58d4492ad7a7751c90eaee31b01c5.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_75d58d4492ad7a7751c90eaee31b01c5.jpg saved to cache
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb9ef50>
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F58%252F76582274df3e4b8cf5914639bc204827%252Fpa%252FSJ72548_50cdd239c08147e82efa074887c65693.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_50cdd239c08147e82efa074887c65693.jpg saved to cache
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2
2026-03-28 18:39:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2, skipping ID generation
2026-03-28 18:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with scrape type 1
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 sending to next pipeline
2026-03-28 18:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2, identifier: SJ72548
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_2227282adfa12bdc792c8f99552dfa23.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_2227282adfa12bdc792c8f99552dfa23.jpg not downloaded yet
2026-03-28 18:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with identifier: SJ72548
2026-03-28 18:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with identifier: SJ72548
2026-03-28 18:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04d9e4da-6166-5b1a-aa26-f24f66e4d0e2 with identifier: SJ72548 to the API
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_50cdd239c08147e82efa074887c65693.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:45:53Z',
 'fuel_type': 'petrol',
 'id': '04d9e4da-6166-5b1a-aa26-f24f66e4d0e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ72548',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 89642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a42e5515fa283d313e2891350b4abd77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_d2731338cfb2796fbf85c12f225cddb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_f1488b2be1a6adee0f42a0b0cc7a1896.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_38b8d1638898b036b8e5f5bc74224df1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_59eb503d56d72508655ee13d44f7155e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_69cfae567892cdf5af309f38419acba1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_75d58d4492ad7a7751c90eaee31b01c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a35dee5ec4b6e690d34d8ccb681600ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_a3c478264ab7ddbbd5b815e6f026cff8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04d9e4da-6166-5b1a-aa26-f24f66e4d0e2/04d9e4da-6166-5b1a-aa26-f24f66e4d0e2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/58/76582274df3e4b8cf5914639bc204827/pa/SJ72548_50cdd239c08147e82efa074887c65693.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2016}
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72548%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [auto1.de] INFO: Saving data for SJ72548: {'created_time': 1774723147.855121, 'last_price_update_time': 1774723147.855132, 'auction_closing_time': 1774885553.0}
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ72548') HTTP/1.1" 204 0
2026-03-28 18:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL97674/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with identifier: YR75150
2026-03-28 18:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with scrape type 1
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_efb9c72bbd16c94b69a3ccc5dd64037f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_efb9c72bbd16c94b69a3ccc5dd64037f.jpg not downloaded yet
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_7bcbb2763c7b225d8f9868a167eec94f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_7bcbb2763c7b225d8f9868a167eec94f.jpg not downloaded yet
2026-03-28 18:39:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_cc628949a571cb2d799c8f2701cdc341.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_cc628949a571cb2d799c8f2701cdc341.jpg not downloaded yet
2026-03-28 18:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY46145> (referer: https://www.auto1.com/v1/car-details-view/CY46145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK21790> (referer: https://www.auto1.com/v1/car-details-view/KK21790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_0ae0da785d697fd080511382c64704ef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_0ae0da785d697fd080511382c64704ef.jpg not downloaded yet
2026-03-28 18:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_39a7711746b871a2954215e19a28c8aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_a0dc53952a27b34632f56483cb4dc8d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_a0dc53952a27b34632f56483cb4dc8d7.jpg not downloaded yet
2026-03-28 18:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR17679> (referer: https://www.auto1.com/v1/car-details-view/FR17679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_21745d4d6078a74a3f3bdb479815fbaa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_21745d4d6078a74a3f3bdb479815fbaa.jpg not downloaded yet
2026-03-28 18:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_bc52018f105bf8f54bf81a3c046e820d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_bc52018f105bf8f54bf81a3c046e820d.jpg not downloaded yet
2026-03-28 18:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC58057> (referer: https://www.auto1.com/v1/car-details-view/NC58057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_e71159a3a3c8cecd279692149f6e8401.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_e71159a3a3c8cecd279692149f6e8401.jpg not downloaded yet
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_f07874ad39210b30097fb0e57b27164f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_f07874ad39210b30097fb0e57b27164f.jpg not downloaded yet
2026-03-28 18:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_ecdeda81c15bad95a0f5f92fbb2b26e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_211008513d886bcd2a0bfa98d64fe8c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_211008513d886bcd2a0bfa98d64fe8c1.jpg not downloaded yet
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_1fce3ab18395cf84633ac11b4b72bcfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_1fce3ab18395cf84633ac11b4b72bcfa.jpg not downloaded yet
2026-03-28 18:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with identifier: CY46145
2026-03-28 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with scrape type 1
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_24795868498e53570c0a3a2aefadd24b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_24795868498e53570c0a3a2aefadd24b.jpg not downloaded yet
2026-03-28 18:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe07466-0fc4-5269-9979-5ea0279ff55d with identifier: KK21790
2026-03-28 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe07466-0fc4-5269-9979-5ea0279ff55d with scrape type 1
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_772d4a1af57d5f6da6243f80d26eaf38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_772d4a1af57d5f6da6243f80d26eaf38.jpg not downloaded yet
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_aa30b0cf1676888f4058cd75d9640d1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_aa30b0cf1676888f4058cd75d9640d1e.jpg not downloaded yet
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_1b07142045b5c920d5892b636feb86fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_1b07142045b5c920d5892b636feb86fb.jpg not downloaded yet
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_f45df5967b411fec0ee4796e97888478.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_f45df5967b411fec0ee4796e97888478.jpg not downloaded yet
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_fb315e800074cf1c55178c6ec39d8994.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_fb315e800074cf1c55178c6ec39d8994.jpg not downloaded yet
2026-03-28 18:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_cc628949a571cb2d799c8f2701cdc341.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda5250>
2026-03-28 18:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252Fae%252Ffeaed284a5f04a95eb2dfff057665e25%252Fpa%252FTP61394_39a7711746b871a2954215e19a28c8aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_39a7711746b871a2954215e19a28c8aa.jpg saved to cache
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595
2026-03-28 18:39:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595, skipping ID generation
2026-03-28 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with scrape type 1
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 sending to next pipeline
2026-03-28 18:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595, identifier: TP61394
2026-03-28 18:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78c7c86b-7048-5056-8bc6-3becd66be11c with identifier: FR17679
2026-03-28 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78c7c86b-7048-5056-8bc6-3becd66be11c with scrape type 1
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 78c7c86b-7048-5056-8bc6-3becd66be11c
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_777079dbc37aa1e3a8d15ada1354fd3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_777079dbc37aa1e3a8d15ada1354fd3c.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_11ad5ced8a8b76dbac76c05d8778e1f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_11ad5ced8a8b76dbac76c05d8778e1f4.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_f11a49639b708cbb2e0b4d02ced7402d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_f11a49639b708cbb2e0b4d02ced7402d.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_6cfeb7b93c8a92edf9bedfa919c65726.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_6cfeb7b93c8a92edf9bedfa919c65726.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_0f7b6175a0556aeb9316b7835d9b9a94.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_0f7b6175a0556aeb9316b7835d9b9a94.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_495eb278d2accfba60a4b920a7e5e363.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_495eb278d2accfba60a4b920a7e5e363.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_f360d65ed0998bb3602bd4c444b3261d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_f360d65ed0998bb3602bd4c444b3261d.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_64c8606aafea85007ab9be0e7bf674d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_64c8606aafea85007ab9be0e7bf674d9.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_38ab08988acd554fb2900b781c328ac9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_38ab08988acd554fb2900b781c328ac9.jpg already downloaded
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8f%252F4b%252F8f4b7c2a20559b44642e154309f1e5cd%252Fpa%252FFR17679_42892debf5c48239156cd60d9f19f591.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_42892debf5c48239156cd60d9f19f591.jpg already downloaded
2026-03-28 18:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78c7c86b-7048-5056-8bc6-3becd66be11c, identifier: FR17679
2026-03-28 18:39:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with identifier: NC58057
2026-03-28 18:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with scrape type 1
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_eb86c960a559870be321e917bd38be3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_eb86c960a559870be321e917bd38be3b.jpg not downloaded yet
2026-03-28 18:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_7bcbb2763c7b225d8f9868a167eec94f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_100f2c73b4b1bf35df34ae788c00a019.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_100f2c73b4b1bf35df34ae788c00a019.jpg not downloaded yet
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_7a863d2365aac159b553527b47b80529.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_7a863d2365aac159b553527b47b80529.jpg not downloaded yet
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_8f975d33d171f4e1c6e7f476b1cdcb37.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8f975d33d171f4e1c6e7f476b1cdcb37.jpg not downloaded yet
2026-03-28 18:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with identifier: TP61394
2026-03-28 18:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with identifier: TP61394
2026-03-28 18:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5be6b186-7fb6-5c74-8f15-cd3e02ef3595 with identifier: TP61394 to the API
2026-03-28 18:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_39a7711746b871a2954215e19a28c8aa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:19Z',
 'fuel_type': 'petrol',
 'id': '5be6b186-7fb6-5c74-8f15-cd3e02ef3595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP61394',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 207006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_f3598c5ecbc63703eab4e63d1e2cd131.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_39a7711746b871a2954215e19a28c8aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_afe9b192e4dac391de14468d1f9d234f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_9d6f67ca775234929ababe756c2c10b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5be6b186-7fb6-5c74-8f15-cd3e02ef3595/5be6b186-7fb6-5c74-8f15-cd3e02ef3595_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/ae/feaed284a5f04a95eb2dfff057665e25/pa/TP61394_e6f6f5394f30d9a974259caaecb604ba.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2009}
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP61394%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Saving data for TP61394: {'created_time': 1774723149.225521, 'last_price_update_time': 1774723149.225533, 'auction_closing_time': 1774885879.0}
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP61394') HTTP/1.1" 204 0
2026-03-28 18:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78c7c86b-7048-5056-8bc6-3becd66be11c with identifier: FR17679
2026-03-28 18:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78c7c86b-7048-5056-8bc6-3becd66be11c with identifier: FR17679
2026-03-28 18:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78c7c86b-7048-5056-8bc6-3becd66be11c with identifier: FR17679 to the API
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FR17679>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:59:50Z',
 'fuel_type': 'diesel',
 'id': '78c7c86b-7048-5056-8bc6-3becd66be11c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR17679',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 51539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_777079dbc37aa1e3a8d15ada1354fd3c.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_11ad5ced8a8b76dbac76c05d8778e1f4.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_f11a49639b708cbb2e0b4d02ced7402d.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_6cfeb7b93c8a92edf9bedfa919c65726.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_0f7b6175a0556aeb9316b7835d9b9a94.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_495eb278d2accfba60a4b920a7e5e363.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_f360d65ed0998bb3602bd4c444b3261d.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_64c8606aafea85007ab9be0e7bf674d9.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_38ab08988acd554fb2900b781c328ac9.jpg',
                'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_42892debf5c48239156cd60d9f19f591.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_777079dbc37aa1e3a8d15ada1354fd3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2764881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_11ad5ced8a8b76dbac76c05d8778e1f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_f11a49639b708cbb2e0b4d02ced7402d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_6cfeb7b93c8a92edf9bedfa919c65726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_0f7b6175a0556aeb9316b7835d9b9a94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_495eb278d2accfba60a4b920a7e5e363.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_f360d65ed0998bb3602bd4c444b3261d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_64c8606aafea85007ab9be0e7bf674d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_38ab08988acd554fb2900b781c328ac9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78c7c86b-7048-5056-8bc6-3becd66be11c/78c7c86b-7048-5056-8bc6-3becd66be11c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8f/4b/8f4b7c2a20559b44642e154309f1e5cd/pa/FR17679_42892debf5c48239156cd60d9f19f591.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-12-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI GTD',
 'transmission': 'automatic',
 'trim': 'GTD',
 'year': 2020}
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR17679%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [auto1.de] INFO: Saving data for FR17679: {'created_time': 1774723149.559941, 'last_price_update_time': 1774723149.559954, 'auction_closing_time': 1774886390.0}
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR17679') HTTP/1.1" 204 0
2026-03-28 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_f07874ad39210b30097fb0e57b27164f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_6d90f7f38048470124bf5027348288d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_6d90f7f38048470124bf5027348288d8.jpg not downloaded yet
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b11fc10>
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_ecdeda81c15bad95a0f5f92fbb2b26e4.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_ecdeda81c15bad95a0f5f92fbb2b26e4.jpg saved to cache
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_5cba1ffccc3eaa5fdaf79d0b88fb2f24.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_5cba1ffccc3eaa5fdaf79d0b88fb2f24.jpg not downloaded yet
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_9c819d2ee09bd2baa7271b1745446beb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_9c819d2ee09bd2baa7271b1745446beb.jpg not downloaded yet
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_6db3def69536d784023545c3f1fbd8c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_6db3def69536d784023545c3f1fbd8c0.jpg not downloaded yet
2026-03-28 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JL46304> (referer: https://www.auto1.com/v1/car-details-view/JL46304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb99d0>
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_cc628949a571cb2d799c8f2701cdc341.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_cc628949a571cb2d799c8f2701cdc341.jpg saved to cache
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_7ba3764a0cbd71b867e68610afd75c35.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_7ba3764a0cbd71b867e68610afd75c35.jpg not downloaded yet
2026-03-28 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC55349> (referer: https://www.auto1.com/v1/car-details-view/DC55349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HV52023> (referer: https://www.auto1.com/v1/car-details-view/HV52023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_d1acdabe0ed7434bba0847022e00b4c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_d1acdabe0ed7434bba0847022e00b4c4.jpg not downloaded yet
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_656f3b33a3d93238c01f10a9bd07bf93.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_656f3b33a3d93238c01f10a9bd07bf93.jpg not downloaded yet
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_8a7a241ef0a9d29de849fe1ee491bab6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8a7a241ef0a9d29de849fe1ee491bab6.jpg not downloaded yet
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b286ad0>
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_7bcbb2763c7b225d8f9868a167eec94f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_7bcbb2763c7b225d8f9868a167eec94f.jpg saved to cache
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_aa30b0cf1676888f4058cd75d9640d1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_d015f9caf29a378f9eb4ea66ee979958.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_d015f9caf29a378f9eb4ea66ee979958.jpg not downloaded yet
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_bd951a880cb45d90b70dccd2cdcf01c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_bd951a880cb45d90b70dccd2cdcf01c3.jpg not downloaded yet
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_72eead01d2e4b9521a8f55ba4663a1ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_72eead01d2e4b9521a8f55ba4663a1ec.jpg not downloaded yet
2026-03-28 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_eb86c960a559870be321e917bd38be3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_fb315e800074cf1c55178c6ec39d8994.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_3b196fa5774b5d40ef7865114455c582.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_3b196fa5774b5d40ef7865114455c582.jpg not downloaded yet
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcc1950>
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_f07874ad39210b30097fb0e57b27164f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_f07874ad39210b30097fb0e57b27164f.jpg saved to cache
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with identifier: JL46304
2026-03-28 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with scrape type 1
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_5b1222934ce2a479a3475848e9b4ef2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_5b1222934ce2a479a3475848e9b4ef2f.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_83fa68e28f070e93a658d98a4138712e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_83fa68e28f070e93a658d98a4138712e.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_8486e50734e939a645c93d5910a1b3b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8486e50734e939a645c93d5910a1b3b7.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_8a519f28c2b2464b0307c6b38137367e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_8a519f28c2b2464b0307c6b38137367e.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_77adb9bf7230c91343cca3a1f436847e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_77adb9bf7230c91343cca3a1f436847e.jpg not downloaded yet
2026-03-28 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with identifier: DC55349
2026-03-28 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with scrape type 1
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_5f5278d8e8592fbae59c4be8870cd8f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_5f5278d8e8592fbae59c4be8870cd8f4.jpg not downloaded yet
2026-03-28 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0af17159-8b74-5aef-bb80-695f654b6a47 with identifier: HV52023
2026-03-28 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af17159-8b74-5aef-bb80-695f654b6a47 with scrape type 1
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0af17159-8b74-5aef-bb80-695f654b6a47
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_302ebc3b116c84f697966cbb211e5550.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_302ebc3b116c84f697966cbb211e5550.jpg not downloaded yet
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_6db3def69536d784023545c3f1fbd8c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_8840d5155214b60716c1bff54040c6e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_8840d5155214b60716c1bff54040c6e8.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_4c7b89a383e46184817f911e1949b9a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_4c7b89a383e46184817f911e1949b9a2.jpg not downloaded yet
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbf9750>
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_aa30b0cf1676888f4058cd75d9640d1e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_aa30b0cf1676888f4058cd75d9640d1e.jpg saved to cache
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_03b71c7bd887c808074e310850ef716d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_03b71c7bd887c808074e310850ef716d.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_3d05839262fe7609dfc734ec7b3e4be0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_3d05839262fe7609dfc734ec7b3e4be0.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_b0e2338b91ca44fa5cda99d996c9ec22.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_b0e2338b91ca44fa5cda99d996c9ec22.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_14c40feb0097b90886cde7bc4db245d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_14c40feb0097b90886cde7bc4db245d8.jpg not downloaded yet
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_9c819d2ee09bd2baa7271b1745446beb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_5a53d191650ab2bb8ee2a7a5643b7f86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_5a53d191650ab2bb8ee2a7a5643b7f86.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_61419b45da3ba9ba88fa8519093bc747.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_61419b45da3ba9ba88fa8519093bc747.jpg not downloaded yet
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb8b50>
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_eb86c960a559870be321e917bd38be3b.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_eb86c960a559870be321e917bd38be3b.jpg saved to cache
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb57810>
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_fb315e800074cf1c55178c6ec39d8994.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_fb315e800074cf1c55178c6ec39d8994.jpg saved to cache
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_5cba1ffccc3eaa5fdaf79d0b88fb2f24.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_7fdd77082608baabe694aeae73a9cffa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_7fdd77082608baabe694aeae73a9cffa.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_54698059b82aa5ea08c4163a8c26baad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_54698059b82aa5ea08c4163a8c26baad.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_eace8883fa9472babace1085ac4f111c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_eace8883fa9472babace1085ac4f111c.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_25bd01f83e4a875c31c0708570456970.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_25bd01f83e4a875c31c0708570456970.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_cbd72a3c03feb24a596f6aa7d0e6d275.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_cbd72a3c03feb24a596f6aa7d0e6d275.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_2dc4932333ef5e87327fe76f02b01820.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_2dc4932333ef5e87327fe76f02b01820.jpg not downloaded yet
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE99206> (referer: https://www.auto1.com/v1/car-details-view/LE99206/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_7ba3764a0cbd71b867e68610afd75c35.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_bdeba89e2bdac5a6a267b0b85528f801.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_bdeba89e2bdac5a6a267b0b85528f801.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_74120c0e81c97948e3565666624b3cec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_74120c0e81c97948e3565666624b3cec.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_7a8dd9dc7beba5fd6e1c4a94e9ad7e89.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_7a8dd9dc7beba5fd6e1c4a94e9ad7e89.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_3a534429ea55afa53b08f6c53a260c78.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_3a534429ea55afa53b08f6c53a260c78.jpg not downloaded yet
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB32886> (referer: https://www.auto1.com/v1/car-details-view/VB32886/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02b950>
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_6db3def69536d784023545c3f1fbd8c0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_6db3def69536d784023545c3f1fbd8c0.jpg saved to cache
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0123d0>
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_9c819d2ee09bd2baa7271b1745446beb.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_9c819d2ee09bd2baa7271b1745446beb.jpg saved to cache
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_0a2ad95e4fb0606cdb9d6c545ac731e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_0a2ad95e4fb0606cdb9d6c545ac731e9.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_0615d30b955aa68647beb63463dba5cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_0615d30b955aa68647beb63463dba5cd.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_6a3c353b4323eef43749c5ec9040081f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_6a3c353b4323eef43749c5ec9040081f.jpg not downloaded yet
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_84294d4b2ef0d16e30179a669c91e02a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_84294d4b2ef0d16e30179a669c91e02a.jpg not downloaded yet
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_d015f9caf29a378f9eb4ea66ee979958.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8a7a241ef0a9d29de849fe1ee491bab6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CC10989/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL97674> (referer: https://www.auto1.com/v1/car-details-view/VL97674/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bddc5d0>
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_5cba1ffccc3eaa5fdaf79d0b88fb2f24.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_5cba1ffccc3eaa5fdaf79d0b88fb2f24.jpg saved to cache
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408557db-da41-508d-823b-fb759e5f5138 with identifier: LE99206
2026-03-28 18:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408557db-da41-508d-823b-fb759e5f5138 with scrape type 1
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 408557db-da41-508d-823b-fb759e5f5138
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_2759af5c4a3745c091c3e632b19e1834.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_2759af5c4a3745c091c3e632b19e1834.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_7b626d8e8549a0e885a101e61c8600a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_7b626d8e8549a0e885a101e61c8600a6.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_a89e84aabcb8de6d41a072d75ce5618d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_a89e84aabcb8de6d41a072d75ce5618d.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_b3d1b8457e524f466dce91edeb39cbc4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_b3d1b8457e524f466dce91edeb39cbc4.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_97a77ce87e5208ce0c7f94a5bd577b38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_97a77ce87e5208ce0c7f94a5bd577b38.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_15c57d059b7d4446ccc68197d845e5de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_15c57d059b7d4446ccc68197d845e5de.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_4ee06d6f422288932105a1a23a59b4f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_4ee06d6f422288932105a1a23a59b4f5.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_f46406c7ca9c8358d59ef842062fa125.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_f46406c7ca9c8358d59ef842062fa125.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_bede0ab005446c4056dbec0d6b2591e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_bede0ab005446c4056dbec0d6b2591e3.jpg already downloaded
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgee%252Fb3%252Feeb3300d30aa5b5dcd211f79722fe670%252Fpa%252FLE99206_879d5da8e75c909be333b26a763c633d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_879d5da8e75c909be333b26a763c633d.jpg already downloaded
2026-03-28 18:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 408557db-da41-508d-823b-fb759e5f5138, identifier: LE99206
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b664a9ed0>
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_7ba3764a0cbd71b867e68610afd75c35.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_7ba3764a0cbd71b867e68610afd75c35.jpg saved to cache
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02e8f92c-b115-5f86-b279-49633f2404c7 with identifier: VB32886
2026-03-28 18:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e8f92c-b115-5f86-b279-49633f2404c7 with scrape type 1
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 02e8f92c-b115-5f86-b279-49633f2404c7
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_d361e355d1eb1d29d6e655e5453fa8cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_d361e355d1eb1d29d6e655e5453fa8cc.jpg not downloaded yet
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_542ef175614250a806a98834a790ea4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_542ef175614250a806a98834a790ea4b.jpg not downloaded yet
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_92cdb3c7ef23eef076b1a22052976e46.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_92cdb3c7ef23eef076b1a22052976e46.jpg not downloaded yet
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_024ce63f9dd3ef148ba084b3cc852c8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_024ce63f9dd3ef148ba084b3cc852c8d.jpg not downloaded yet
2026-03-28 18:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 408557db-da41-508d-823b-fb759e5f5138 with identifier: LE99206
2026-03-28 18:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 408557db-da41-508d-823b-fb759e5f5138 with identifier: LE99206
2026-03-28 18:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 408557db-da41-508d-823b-fb759e5f5138 with identifier: LE99206 to the API
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LE99206>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:45:42Z',
 'fuel_type': 'diesel',
 'id': '408557db-da41-508d-823b-fb759e5f5138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE99206',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 89145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_2759af5c4a3745c091c3e632b19e1834.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_7b626d8e8549a0e885a101e61c8600a6.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_a89e84aabcb8de6d41a072d75ce5618d.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_b3d1b8457e524f466dce91edeb39cbc4.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_97a77ce87e5208ce0c7f94a5bd577b38.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_15c57d059b7d4446ccc68197d845e5de.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_4ee06d6f422288932105a1a23a59b4f5.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_f46406c7ca9c8358d59ef842062fa125.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_bede0ab005446c4056dbec0d6b2591e3.jpg',
                'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_879d5da8e75c909be333b26a763c633d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_2759af5c4a3745c091c3e632b19e1834.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_7b626d8e8549a0e885a101e61c8600a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_a89e84aabcb8de6d41a072d75ce5618d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_b3d1b8457e524f466dce91edeb39cbc4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_97a77ce87e5208ce0c7f94a5bd577b38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_15c57d059b7d4446ccc68197d845e5de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_4ee06d6f422288932105a1a23a59b4f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_f46406c7ca9c8358d59ef842062fa125.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_bede0ab005446c4056dbec0d6b2591e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408557db-da41-508d-823b-fb759e5f5138/408557db-da41-508d-823b-fb759e5f5138_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgee/b3/eeb3300d30aa5b5dcd211f79722fe670/pa/LE99206_879d5da8e75c909be333b26a763c633d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE99206%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [auto1.de] INFO: Saving data for LE99206: {'created_time': 1774723151.665547, 'last_price_update_time': 1774723151.665558, 'auction_closing_time': 1774885542.0}
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE99206') HTTP/1.1" 204 0
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_54d0027dac26dec528f904a4165e0010.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_54d0027dac26dec528f904a4165e0010.jpg not downloaded yet
2026-03-28 18:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8486e50734e939a645c93d5910a1b3b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_672d791333cb67d29cc9a65c78d04ef4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_672d791333cb67d29cc9a65c78d04ef4.jpg not downloaded yet
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_66fd8fa6db02fd12d03d4bc86a860f78.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_66fd8fa6db02fd12d03d4bc86a860f78.jpg not downloaded yet
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2ec850>
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_d015f9caf29a378f9eb4ea66ee979958.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_d015f9caf29a378f9eb4ea66ee979958.jpg saved to cache
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be79c50>
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_8a7a241ef0a9d29de849fe1ee491bab6.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8a7a241ef0a9d29de849fe1ee491bab6.jpg saved to cache
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 105db2dd-cf74-5108-900a-6bc078914458 with identifier: VL97674
2026-03-28 18:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 105db2dd-cf74-5108-900a-6bc078914458 with scrape type 1
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 105db2dd-cf74-5108-900a-6bc078914458
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F4e%252F634ed21a4e0712e3bccb9385b025fae3%252Fpa%252FVL97674_3d2fa71e5c65032304d78d2d136f44eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_3d2fa71e5c65032304d78d2d136f44eb.jpg already downloaded
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F4e%252F634ed21a4e0712e3bccb9385b025fae3%252Fpa%252FVL97674_ac27b8fea970fa8614b592bac31b3a44.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_ac27b8fea970fa8614b592bac31b3a44.jpg already downloaded
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F4e%252F634ed21a4e0712e3bccb9385b025fae3%252Fpa%252FVL97674_15a1bce202b7d81a145b770636bcee9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_15a1bce202b7d81a145b770636bcee9f.jpg already downloaded
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F4e%252F634ed21a4e0712e3bccb9385b025fae3%252Fpa%252FVL97674_61b7c64dbce16e4447fba7cfcf663378.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_61b7c64dbce16e4447fba7cfcf663378.jpg already downloaded
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F4e%252F634ed21a4e0712e3bccb9385b025fae3%252Fpa%252FVL97674_9def49680e480512339ca605a8d5a52c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_9def49680e480512339ca605a8d5a52c.jpg already downloaded
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F4e%252F634ed21a4e0712e3bccb9385b025fae3%252Fpa%252FVL97674_e47b1c5c3a33ec57f2114c35908e60d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_e47b1c5c3a33ec57f2114c35908e60d1.jpg already downloaded
2026-03-28 18:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 105db2dd-cf74-5108-900a-6bc078914458, identifier: VL97674
2026-03-28 18:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_14c40feb0097b90886cde7bc4db245d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_4c7b89a383e46184817f911e1949b9a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_55010ee14b3f22b7edf92f21aa220d46.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_55010ee14b3f22b7edf92f21aa220d46.jpg not downloaded yet
2026-03-28 18:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 105db2dd-cf74-5108-900a-6bc078914458 with identifier: VL97674
2026-03-28 18:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 105db2dd-cf74-5108-900a-6bc078914458 with identifier: VL97674
2026-03-28 18:39:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 105db2dd-cf74-5108-900a-6bc078914458 with identifier: VL97674 to the API
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VL97674>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.2L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:19:46Z',
 'fuel_type': 'diesel',
 'id': '105db2dd-cf74-5108-900a-6bc078914458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL97674',
 'listing': 'auction',
 'location': 'DE, Überherrn',
 'make': 'Mazda',
 'model': '6',
 'odometer': 344337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_3d2fa71e5c65032304d78d2d136f44eb.jpg',
                'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_ac27b8fea970fa8614b592bac31b3a44.jpg',
                'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_15a1bce202b7d81a145b770636bcee9f.jpg',
                'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_61b7c64dbce16e4447fba7cfcf663378.jpg',
                'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_9def49680e480512339ca605a8d5a52c.jpg',
                'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_e47b1c5c3a33ec57f2114c35908e60d1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105db2dd-cf74-5108-900a-6bc078914458/105db2dd-cf74-5108-900a-6bc078914458_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_3d2fa71e5c65032304d78d2d136f44eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105db2dd-cf74-5108-900a-6bc078914458/105db2dd-cf74-5108-900a-6bc078914458_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_ac27b8fea970fa8614b592bac31b3a44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105db2dd-cf74-5108-900a-6bc078914458/105db2dd-cf74-5108-900a-6bc078914458_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_15a1bce202b7d81a145b770636bcee9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105db2dd-cf74-5108-900a-6bc078914458/105db2dd-cf74-5108-900a-6bc078914458_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_61b7c64dbce16e4447fba7cfcf663378.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105db2dd-cf74-5108-900a-6bc078914458/105db2dd-cf74-5108-900a-6bc078914458_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_9def49680e480512339ca605a8d5a52c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_105db2dd-cf74-5108-900a-6bc078914458/105db2dd-cf74-5108-900a-6bc078914458_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/4e/634ed21a4e0712e3bccb9385b025fae3/pa/VL97674_e47b1c5c3a33ec57f2114c35908e60d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel CRDT Dynamic',
 'transmission': 'manual',
 'trim': 'CRDT Dynamic',
 'year': 2009}
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL97674%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [auto1.de] INFO: Saving data for VL97674: {'created_time': 1774723152.375741, 'last_price_update_time': 1774723152.375752, 'auction_closing_time': 1774883986.0}
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL97674') HTTP/1.1" 204 0
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_8a3e1ad19003b64ea417054aeb4cf5b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_8a3e1ad19003b64ea417054aeb4cf5b2.jpg not downloaded yet
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_22d8ad82ade88fb5eff5213ab5886b12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_22d8ad82ade88fb5eff5213ab5886b12.jpg not downloaded yet
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_de7460d8be705a22e96c2fad3cf709ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_de7460d8be705a22e96c2fad3cf709ee.jpg not downloaded yet
2026-03-28 18:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UL28707> (referer: https://www.auto1.com/v1/car-details-view/UL28707/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd991d0>
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_8486e50734e939a645c93d5910a1b3b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8486e50734e939a645c93d5910a1b3b7.jpg saved to cache
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_25bd01f83e4a875c31c0708570456970.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_51cf20b911fd4cd23e85afca8b07c328.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_51cf20b911fd4cd23e85afca8b07c328.jpg not downloaded yet
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_1ad8340feafe1cb04af28f283c01d28a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_1ad8340feafe1cb04af28f283c01d28a.jpg not downloaded yet
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_acd3da0abbb998329ebe706489d072e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_acd3da0abbb998329ebe706489d072e9.jpg not downloaded yet
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda5050>
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_14c40feb0097b90886cde7bc4db245d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_14c40feb0097b90886cde7bc4db245d8.jpg saved to cache
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0af17159-8b74-5aef-bb80-695f654b6a47
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0773d0>
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_4c7b89a383e46184817f911e1949b9a2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_4c7b89a383e46184817f911e1949b9a2.jpg saved to cache
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_89fb23625485321b4b0707a1b23e33a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_89fb23625485321b4b0707a1b23e33a7.jpg not downloaded yet
2026-03-28 18:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_eace8883fa9472babace1085ac4f111c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_2dc4932333ef5e87327fe76f02b01820.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_450e238b022c29e95a437f9890c070f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_450e238b022c29e95a437f9890c070f2.jpg not downloaded yet
2026-03-28 18:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_41490b2b52debc9ea7334f476830fa70.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with identifier: UL28707
2026-03-28 18:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with scrape type 1
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_feda5145afe2426dc367412d04157cbb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_feda5145afe2426dc367412d04157cbb.jpg not downloaded yet
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bddea50>
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_25bd01f83e4a875c31c0708570456970.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_25bd01f83e4a875c31c0708570456970.jpg saved to cache
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0af17159-8b74-5aef-bb80-695f654b6a47
2026-03-28 18:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_3a534429ea55afa53b08f6c53a260c78.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_6e64f4b96836029d0b07e20745894d13.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6e64f4b96836029d0b07e20745894d13.jpg not downloaded yet
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcc550>
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_eace8883fa9472babace1085ac4f111c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_eace8883fa9472babace1085ac4f111c.jpg saved to cache
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10dc90>
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_2dc4932333ef5e87327fe76f02b01820.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_2dc4932333ef5e87327fe76f02b01820.jpg saved to cache
2026-03-28 18:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc5fd50>
2026-03-28 18:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_41490b2b52debc9ea7334f476830fa70.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_41490b2b52debc9ea7334f476830fa70.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_fd4eadba0ec1a880bc5d3ef3d9be00e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_fd4eadba0ec1a880bc5d3ef3d9be00e7.jpg not downloaded yet
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_4f8e2a20bee8e0b60f34d4ccaf3f3d1f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_7a8dd9dc7beba5fd6e1c4a94e9ad7e89.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_40a6133d3fe8c6fbd839e529c8a885c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_84294d4b2ef0d16e30179a669c91e02a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_b3c06c46e00434974ddbffacf087e2ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_b3c06c46e00434974ddbffacf087e2ae.jpg not downloaded yet
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb37a90>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_3a534429ea55afa53b08f6c53a260c78.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_3a534429ea55afa53b08f6c53a260c78.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0af17159-8b74-5aef-bb80-695f654b6a47
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_6dc136d287800c942a0eac8df32b80f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6dc136d287800c942a0eac8df32b80f5.jpg not downloaded yet
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_2227282adfa12bdc792c8f99552dfa23.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_024ce63f9dd3ef148ba084b3cc852c8d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_0ae0da785d697fd080511382c64704ef.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_6a3c353b4323eef43749c5ec9040081f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcf2e10>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_4f8e2a20bee8e0b60f34d4ccaf3f3d1f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_4f8e2a20bee8e0b60f34d4ccaf3f3d1f.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b186f10>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_7a8dd9dc7beba5fd6e1c4a94e9ad7e89.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_7a8dd9dc7beba5fd6e1c4a94e9ad7e89.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_54d0027dac26dec528f904a4165e0010.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_de7460d8be705a22e96c2fad3cf709ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_feda5145afe2426dc367412d04157cbb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_22d8ad82ade88fb5eff5213ab5886b12.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_92cdb3c7ef23eef076b1a22052976e46.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_acd3da0abbb998329ebe706489d072e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6acd0>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_40a6133d3fe8c6fbd839e529c8a885c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_40a6133d3fe8c6fbd839e529c8a885c2.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c7150>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_84294d4b2ef0d16e30179a669c91e02a.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_84294d4b2ef0d16e30179a669c91e02a.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0af17159-8b74-5aef-bb80-695f654b6a47
2026-03-28 18:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bddba50>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_2227282adfa12bdc792c8f99552dfa23.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_2227282adfa12bdc792c8f99552dfa23.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be8a550>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_024ce63f9dd3ef148ba084b3cc852c8d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_024ce63f9dd3ef148ba084b3cc852c8d.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0af17159-8b74-5aef-bb80-695f654b6a47
2026-03-28 18:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc20450>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_0ae0da785d697fd080511382c64704ef.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_0ae0da785d697fd080511382c64704ef.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b2a50>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_6a3c353b4323eef43749c5ec9040081f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_6a3c353b4323eef43749c5ec9040081f.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb34110>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_54d0027dac26dec528f904a4165e0010.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_54d0027dac26dec528f904a4165e0010.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02e8f92c-b115-5f86-b279-49633f2404c7
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05a850>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_de7460d8be705a22e96c2fad3cf709ee.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_de7460d8be705a22e96c2fad3cf709ee.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02e8f92c-b115-5f86-b279-49633f2404c7
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd17e90>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_feda5145afe2426dc367412d04157cbb.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_feda5145afe2426dc367412d04157cbb.jpg saved to cache
2026-03-28 18:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05b2d0>
2026-03-28 18:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_22d8ad82ade88fb5eff5213ab5886b12.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_22d8ad82ade88fb5eff5213ab5886b12.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2444d0>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_92cdb3c7ef23eef076b1a22052976e46.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_92cdb3c7ef23eef076b1a22052976e46.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05a410>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_acd3da0abbb998329ebe706489d072e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_acd3da0abbb998329ebe706489d072e9.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02e8f92c-b115-5f86-b279-49633f2404c7
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_89fb23625485321b4b0707a1b23e33a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_1ad8340feafe1cb04af28f283c01d28a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6dc136d287800c942a0eac8df32b80f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_fd4eadba0ec1a880bc5d3ef3d9be00e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_b3c06c46e00434974ddbffacf087e2ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_55010ee14b3f22b7edf92f21aa220d46.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1d1190>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_89fb23625485321b4b0707a1b23e33a7.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_89fb23625485321b4b0707a1b23e33a7.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_d361e355d1eb1d29d6e655e5453fa8cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_51cf20b911fd4cd23e85afca8b07c328.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6e64f4b96836029d0b07e20745894d13.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be70d50>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_1ad8340feafe1cb04af28f283c01d28a.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_1ad8340feafe1cb04af28f283c01d28a.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdccc90>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_6dc136d287800c942a0eac8df32b80f5.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6dc136d287800c942a0eac8df32b80f5.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd9ad0>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_fd4eadba0ec1a880bc5d3ef3d9be00e7.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_fd4eadba0ec1a880bc5d3ef3d9be00e7.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcc210>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_b3c06c46e00434974ddbffacf087e2ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_b3c06c46e00434974ddbffacf087e2ae.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10e850>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_55010ee14b3f22b7edf92f21aa220d46.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_55010ee14b3f22b7edf92f21aa220d46.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02e8f92c-b115-5f86-b279-49633f2404c7
2026-03-28 18:39:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_450e238b022c29e95a437f9890c070f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd491d0>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_d361e355d1eb1d29d6e655e5453fa8cc.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_d361e355d1eb1d29d6e655e5453fa8cc.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02e8f92c-b115-5f86-b279-49633f2404c7
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdde250>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_51cf20b911fd4cd23e85afca8b07c328.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_51cf20b911fd4cd23e85afca8b07c328.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1020d0>
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252F85%252F48854ed58c6f87be027d0d5631558c72%252Fpa%252FUL28707_6e64f4b96836029d0b07e20745894d13.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6e64f4b96836029d0b07e20745894d13.jpg saved to cache
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a
2026-03-28 18:39:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a, skipping ID generation
2026-03-28 18:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with scrape type 1
2026-03-28 18:39:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a sending to next pipeline
2026-03-28 18:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a, identifier: UL28707
2026-03-28 18:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with identifier: UL28707
2026-03-28 18:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with identifier: UL28707
2026-03-28 18:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a with identifier: UL28707 to the API
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6e64f4b96836029d0b07e20745894d13.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:39:32Z',
 'fuel_type': 'petrol',
 'id': '9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UL28707',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 160452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_feda5145afe2426dc367412d04157cbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6e64f4b96836029d0b07e20745894d13.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_fd4eadba0ec1a880bc5d3ef3d9be00e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_b3c06c46e00434974ddbffacf087e2ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a/9c7de0b9-afc4-5d5a-92ba-fad6dc6bcf4a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/85/48854ed58c6f87be027d0d5631558c72/pa/UL28707_6dc136d287800c942a0eac8df32b80f5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-08-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2007}
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL28707%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [auto1.de] INFO: Saving data for UL28707: {'created_time': 1774723155.467399, 'last_price_update_time': 1774723155.46741, 'auction_closing_time': 1774885172.0}
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UL28707') HTTP/1.1" 204 0
2026-03-28 18:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_74120c0e81c97948e3565666624b3cec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_0a2ad95e4fb0606cdb9d6c545ac731e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_bdeba89e2bdac5a6a267b0b85528f801.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CC10989> (referer: https://www.auto1.com/v1/car-details-view/CC10989/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b207550>
2026-03-28 18:39:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F51%252Fa051f197c5cfdbbe6d80e836d68413ff%252Fpa%252FVB32886_450e238b022c29e95a437f9890c070f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_450e238b022c29e95a437f9890c070f2.jpg saved to cache
2026-03-28 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02e8f92c-b115-5f86-b279-49633f2404c7
2026-03-28 18:39:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02e8f92c-b115-5f86-b279-49633f2404c7, skipping ID generation
2026-03-28 18:39:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02e8f92c-b115-5f86-b279-49633f2404c7 with scrape type 1
2026-03-28 18:39:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02e8f92c-b115-5f86-b279-49633f2404c7 sending to next pipeline
2026-03-28 18:39:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02e8f92c-b115-5f86-b279-49633f2404c7, identifier: VB32886
2026-03-28 18:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02e8f92c-b115-5f86-b279-49633f2404c7 with identifier: VB32886
2026-03-28 18:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02e8f92c-b115-5f86-b279-49633f2404c7 with identifier: VB32886
2026-03-28 18:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02e8f92c-b115-5f86-b279-49633f2404c7 with identifier: VB32886 to the API
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_450e238b022c29e95a437f9890c070f2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:43:35Z',
 'fuel_type': 'petrol',
 'id': '02e8f92c-b115-5f86-b279-49633f2404c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB32886',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 117017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92589,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_d361e355d1eb1d29d6e655e5453fa8cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_54d0027dac26dec528f904a4165e0010.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_55010ee14b3f22b7edf92f21aa220d46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69943,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_de7460d8be705a22e96c2fad3cf709ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_acd3da0abbb998329ebe706489d072e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02e8f92c-b115-5f86-b279-49633f2404c7/02e8f92c-b115-5f86-b279-49633f2404c7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/51/a051f197c5cfdbbe6d80e836d68413ff/pa/VB32886_450e238b022c29e95a437f9890c070f2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Agila 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB32886%27 HTTP/1.1" 200 None
2026-03-28 18:39:15 [auto1.de] INFO: Saving data for VB32886: {'created_time': 1774723155.997376, 'last_price_update_time': 1774723155.997393, 'auction_closing_time': 1774885415.0}
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB32886') HTTP/1.1" 204 0
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_54698059b82aa5ea08c4163a8c26baad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_cbd72a3c03feb24a596f6aa7d0e6d275.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_7fdd77082608baabe694aeae73a9cffa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b204dd0>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_74120c0e81c97948e3565666624b3cec.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_74120c0e81c97948e3565666624b3cec.jpg saved to cache
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7fbd0>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_0a2ad95e4fb0606cdb9d6c545ac731e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_0a2ad95e4fb0606cdb9d6c545ac731e9.jpg saved to cache
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b06e890>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_bdeba89e2bdac5a6a267b0b85528f801.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_bdeba89e2bdac5a6a267b0b85528f801.jpg saved to cache
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee7fd7ae-911e-5316-8aa8-a0747560c412 with identifier: CC10989
2026-03-28 18:39:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee7fd7ae-911e-5316-8aa8-a0747560c412 with scrape type 1
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item ee7fd7ae-911e-5316-8aa8-a0747560c412
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fa0%252Fbea0b83f42ac572c7435ce225182a4e2%252Fpa%252FCC10989_c8cb8e005a37d6fbf7865b14b8374188.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_c8cb8e005a37d6fbf7865b14b8374188.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fa0%252Fbea0b83f42ac572c7435ce225182a4e2%252Fpa%252FCC10989_340c59aff40c338b21c7df8e1a43d2ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_340c59aff40c338b21c7df8e1a43d2ca.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fa0%252Fbea0b83f42ac572c7435ce225182a4e2%252Fpa%252FCC10989_48f1dfa58be3f3742046db29004e0419.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_48f1dfa58be3f3742046db29004e0419.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fa0%252Fbea0b83f42ac572c7435ce225182a4e2%252Fpa%252FCC10989_9f8081a9724d86de4d0380662c097da3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_9f8081a9724d86de4d0380662c097da3.jpg already downloaded
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252Fa0%252Fbea0b83f42ac572c7435ce225182a4e2%252Fpa%252FCC10989_d44a80e1596d3332e3c2ff75670c97d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_d44a80e1596d3332e3c2ff75670c97d4.jpg already downloaded
2026-03-28 18:39:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee7fd7ae-911e-5316-8aa8-a0747560c412, identifier: CC10989
2026-03-28 18:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee7fd7ae-911e-5316-8aa8-a0747560c412 with identifier: CC10989
2026-03-28 18:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee7fd7ae-911e-5316-8aa8-a0747560c412 with identifier: CC10989
2026-03-28 18:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee7fd7ae-911e-5316-8aa8-a0747560c412 with identifier: CC10989 to the API
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CC10989>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': 'Rental',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:31:30Z',
 'fuel_type': 'petrol',
 'id': 'ee7fd7ae-911e-5316-8aa8-a0747560c412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC10989',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 181502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_c8cb8e005a37d6fbf7865b14b8374188.jpg',
                'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_340c59aff40c338b21c7df8e1a43d2ca.jpg',
                'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_48f1dfa58be3f3742046db29004e0419.jpg',
                'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_9f8081a9724d86de4d0380662c097da3.jpg',
                'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_d44a80e1596d3332e3c2ff75670c97d4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee7fd7ae-911e-5316-8aa8-a0747560c412/ee7fd7ae-911e-5316-8aa8-a0747560c412_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_c8cb8e005a37d6fbf7865b14b8374188.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee7fd7ae-911e-5316-8aa8-a0747560c412/ee7fd7ae-911e-5316-8aa8-a0747560c412_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_340c59aff40c338b21c7df8e1a43d2ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee7fd7ae-911e-5316-8aa8-a0747560c412/ee7fd7ae-911e-5316-8aa8-a0747560c412_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_48f1dfa58be3f3742046db29004e0419.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee7fd7ae-911e-5316-8aa8-a0747560c412/ee7fd7ae-911e-5316-8aa8-a0747560c412_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_9f8081a9724d86de4d0380662c097da3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee7fd7ae-911e-5316-8aa8-a0747560c412/ee7fd7ae-911e-5316-8aa8-a0747560c412_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113915,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/a0/bea0b83f42ac572c7435ce225182a4e2/pa/CC10989_d44a80e1596d3332e3c2ff75670c97d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Energy',
 'transmission': 'manual',
 'trim': 'Energy',
 'year': 2014}
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC10989%27 HTTP/1.1" 200 None
2026-03-28 18:39:16 [auto1.de] INFO: Saving data for CC10989: {'created_time': 1774723156.644973, 'last_price_update_time': 1774723156.644985, 'auction_closing_time': 1774884690.0}
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC10989') HTTP/1.1" 204 0
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c79d0>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_54698059b82aa5ea08c4163a8c26baad.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_54698059b82aa5ea08c4163a8c26baad.jpg saved to cache
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf0e10>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_cbd72a3c03feb24a596f6aa7d0e6d275.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_cbd72a3c03feb24a596f6aa7d0e6d275.jpg saved to cache
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb37690>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_7fdd77082608baabe694aeae73a9cffa.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_7fdd77082608baabe694aeae73a9cffa.jpg saved to cache
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_5a53d191650ab2bb8ee2a7a5643b7f86.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_b0e2338b91ca44fa5cda99d996c9ec22.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_61419b45da3ba9ba88fa8519093bc747.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_8a3e1ad19003b64ea417054aeb4cf5b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_66fd8fa6db02fd12d03d4bc86a860f78.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_672d791333cb67d29cc9a65c78d04ef4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_542ef175614250a806a98834a790ea4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_0615d30b955aa68647beb63463dba5cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_302ebc3b116c84f697966cbb211e5550.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbba490>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_5a53d191650ab2bb8ee2a7a5643b7f86.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_5a53d191650ab2bb8ee2a7a5643b7f86.jpg saved to cache
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1fa090>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_b0e2338b91ca44fa5cda99d996c9ec22.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_b0e2338b91ca44fa5cda99d996c9ec22.jpg saved to cache
2026-03-28 18:39:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be89390>
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_61419b45da3ba9ba88fa8519093bc747.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_61419b45da3ba9ba88fa8519093bc747.jpg saved to cache
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_03b71c7bd887c808074e310850ef716d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_8840d5155214b60716c1bff54040c6e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_3d05839262fe7609dfc734ec7b3e4be0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bce5b50>
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_8a3e1ad19003b64ea417054aeb4cf5b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_8a3e1ad19003b64ea417054aeb4cf5b2.jpg saved to cache
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbdb910>
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_66fd8fa6db02fd12d03d4bc86a860f78.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_66fd8fa6db02fd12d03d4bc86a860f78.jpg saved to cache
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b03ec50>
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_672d791333cb67d29cc9a65c78d04ef4.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_672d791333cb67d29cc9a65c78d04ef4.jpg saved to cache
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd8850>
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_542ef175614250a806a98834a790ea4b.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_542ef175614250a806a98834a790ea4b.jpg saved to cache
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf2410>
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_0615d30b955aa68647beb63463dba5cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_0615d30b955aa68647beb63463dba5cd.jpg saved to cache
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda6c90>
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgfe%252F0f%252Ffe0f1e455ebaef6fc6176ba2b5e4ecf9%252Fpa%252FHV52023_302ebc3b116c84f697966cbb211e5550.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_302ebc3b116c84f697966cbb211e5550.jpg saved to cache
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0af17159-8b74-5aef-bb80-695f654b6a47
2026-03-28 18:39:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0af17159-8b74-5aef-bb80-695f654b6a47, skipping ID generation
2026-03-28 18:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0af17159-8b74-5aef-bb80-695f654b6a47 with scrape type 1
2026-03-28 18:39:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0af17159-8b74-5aef-bb80-695f654b6a47 sending to next pipeline
2026-03-28 18:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0af17159-8b74-5aef-bb80-695f654b6a47, identifier: HV52023
2026-03-28 18:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0af17159-8b74-5aef-bb80-695f654b6a47 with identifier: HV52023
2026-03-28 18:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0af17159-8b74-5aef-bb80-695f654b6a47 with identifier: HV52023
2026-03-28 18:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0af17159-8b74-5aef-bb80-695f654b6a47 with identifier: HV52023 to the API
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_302ebc3b116c84f697966cbb211e5550.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:55:52Z',
 'fuel_type': 'petrol',
 'id': '0af17159-8b74-5aef-bb80-695f654b6a47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV52023',
 'listing': 'auction',
 'location': 'DE, Neustadt an der Weinstraße',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 140496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_302ebc3b116c84f697966cbb211e5550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_14c40feb0097b90886cde7bc4db245d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_25bd01f83e4a875c31c0708570456970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66534,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_3a534429ea55afa53b08f6c53a260c78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_84294d4b2ef0d16e30179a669c91e02a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0af17159-8b74-5aef-bb80-695f654b6a47/0af17159-8b74-5aef-bb80-695f654b6a47_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68222,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfe/0f/fe0f1e455ebaef6fc6176ba2b5e4ecf9/pa/HV52023_024ce63f9dd3ef148ba084b3cc852c8d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-01-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2015}
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV52023%27 HTTP/1.1" 200 None
2026-03-28 18:39:18 [auto1.de] INFO: Saving data for HV52023: {'created_time': 1774723158.717424, 'last_price_update_time': 1774723158.717436, 'auction_closing_time': 1774886152.0}
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV52023') HTTP/1.1" 204 0
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc8b9d0>
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_03b71c7bd887c808074e310850ef716d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_03b71c7bd887c808074e310850ef716d.jpg saved to cache
2026-03-28 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc9c310>
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_8840d5155214b60716c1bff54040c6e8.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_8840d5155214b60716c1bff54040c6e8.jpg saved to cache
2026-03-28 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b58c0db50>
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_3d05839262fe7609dfc734ec7b3e4be0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_3d05839262fe7609dfc734ec7b3e4be0.jpg saved to cache
2026-03-28 18:39:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_3b196fa5774b5d40ef7865114455c582.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_72eead01d2e4b9521a8f55ba4663a1ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_bd951a880cb45d90b70dccd2cdcf01c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_5f5278d8e8592fbae59c4be8870cd8f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_77adb9bf7230c91343cca3a1f436847e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_5b1222934ce2a479a3475848e9b4ef2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_83fa68e28f070e93a658d98a4138712e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_8a519f28c2b2464b0307c6b38137367e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd15350>
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_3b196fa5774b5d40ef7865114455c582.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_3b196fa5774b5d40ef7865114455c582.jpg saved to cache
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd16250>
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_72eead01d2e4b9521a8f55ba4663a1ec.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_72eead01d2e4b9521a8f55ba4663a1ec.jpg saved to cache
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16f150>
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_bd951a880cb45d90b70dccd2cdcf01c3.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_bd951a880cb45d90b70dccd2cdcf01c3.jpg saved to cache
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_d1acdabe0ed7434bba0847022e00b4c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_656f3b33a3d93238c01f10a9bd07bf93.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_1b07142045b5c920d5892b636feb86fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_6d90f7f38048470124bf5027348288d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6b610>
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd0%252F6cd085fdeadf9a0d4ee9c2df8c531873%252Fpa%252FDC55349_5f5278d8e8592fbae59c4be8870cd8f4.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_5f5278d8e8592fbae59c4be8870cd8f4.jpg saved to cache
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779
2026-03-28 18:39:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79c5939e-6fe7-50c8-92bf-ab87d5a83779, skipping ID generation
2026-03-28 18:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with scrape type 1
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79c5939e-6fe7-50c8-92bf-ab87d5a83779 sending to next pipeline
2026-03-28 18:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79c5939e-6fe7-50c8-92bf-ab87d5a83779, identifier: DC55349
2026-03-28 18:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a1d6dd0>
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_77adb9bf7230c91343cca3a1f436847e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_77adb9bf7230c91343cca3a1f436847e.jpg saved to cache
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7d990>
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252F40%252Fe54021bd1cd9f68af90dc3495c16ea2d%252Fpa%252FJL46304_5b1222934ce2a479a3475848e9b4ef2f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_5b1222934ce2a479a3475848e9b4ef2f.jpg saved to cache
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102
2026-03-28 18:39:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1412a0d5-fb2d-5511-a1d7-1ce67251c102, skipping ID generation
2026-03-28 18:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with scrape type 1
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1412a0d5-fb2d-5511-a1d7-1ce67251c102 sending to next pipeline
2026-03-28 18:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1412a0d5-fb2d-5511-a1d7-1ce67251c102, identifier: JL46304
2026-03-28 18:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb95290>
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_83fa68e28f070e93a658d98a4138712e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_83fa68e28f070e93a658d98a4138712e.jpg saved to cache
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7f610>
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_8a519f28c2b2464b0307c6b38137367e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_8a519f28c2b2464b0307c6b38137367e.jpg saved to cache
2026-03-28 18:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_100f2c73b4b1bf35df34ae788c00a019.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with identifier: DC55349
2026-03-28 18:39:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with identifier: DC55349
2026-03-28 18:39:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79c5939e-6fe7-50c8-92bf-ab87d5a83779 with identifier: DC55349 to the API
2026-03-28 18:39:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_5f5278d8e8592fbae59c4be8870cd8f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:10:40Z',
 'fuel_type': 'diesel',
 'id': '79c5939e-6fe7-50c8-92bf-ab87d5a83779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC55349',
 'listing': 'auction',
 'location': 'DE, Hagen',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 168074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2360541,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_5f5278d8e8592fbae59c4be8870cd8f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_b0e2338b91ca44fa5cda99d996c9ec22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_eace8883fa9472babace1085ac4f111c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_7a8dd9dc7beba5fd6e1c4a94e9ad7e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2281148,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_6a3c353b4323eef43749c5ec9040081f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_92cdb3c7ef23eef076b1a22052976e46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2331151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_66fd8fa6db02fd12d03d4bc86a860f78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_22d8ad82ade88fb5eff5213ab5886b12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2250429,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_1ad8340feafe1cb04af28f283c01d28a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79c5939e-6fe7-50c8-92bf-ab87d5a83779/79c5939e-6fe7-50c8-92bf-ab87d5a83779_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2154662,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d0/6cd085fdeadf9a0d4ee9c2df8c531873/pa/DC55349_89fb23625485321b4b0707a1b23e33a7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC55349%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Saving data for DC55349: {'created_time': 1774723160.237654, 'last_price_update_time': 1774723160.237665, 'auction_closing_time': 1774883440.0}
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC55349') HTTP/1.1" 204 0
2026-03-28 18:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with identifier: JL46304
2026-03-28 18:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with identifier: JL46304
2026-03-28 18:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1412a0d5-fb2d-5511-a1d7-1ce67251c102 with identifier: JL46304 to the API
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_5b1222934ce2a479a3475848e9b4ef2f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:48:47Z',
 'fuel_type': 'petrol',
 'id': '1412a0d5-fb2d-5511-a1d7-1ce67251c102',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL46304',
 'listing': 'auction',
 'location': 'DE, Gelsenkirchen',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 71734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_5b1222934ce2a479a3475848e9b4ef2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_77adb9bf7230c91343cca3a1f436847e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73198,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_3d05839262fe7609dfc734ec7b3e4be0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_54698059b82aa5ea08c4163a8c26baad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_74120c0e81c97948e3565666624b3cec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605897,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_0615d30b955aa68647beb63463dba5cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2674025,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_542ef175614250a806a98834a790ea4b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2588769,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_672d791333cb67d29cc9a65c78d04ef4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662538,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_8a3e1ad19003b64ea417054aeb4cf5b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1412a0d5-fb2d-5511-a1d7-1ce67251c102/1412a0d5-fb2d-5511-a1d7-1ce67251c102_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/40/e54021bd1cd9f68af90dc3495c16ea2d/pa/JL46304_51cf20b911fd4cd23e85afca8b07c328.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL46304%27 HTTP/1.1" 200 None
2026-03-28 18:39:20 [auto1.de] INFO: Saving data for JL46304: {'created_time': 1774723160.604409, 'last_price_update_time': 1774723160.604422, 'auction_closing_time': 1774885727.0}
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL46304') HTTP/1.1" 204 0
2026-03-28 18:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_24795868498e53570c0a3a2aefadd24b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_772d4a1af57d5f6da6243f80d26eaf38.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_211008513d886bcd2a0bfa98d64fe8c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b00b310>
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_d1acdabe0ed7434bba0847022e00b4c4.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_d1acdabe0ed7434bba0847022e00b4c4.jpg saved to cache
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59cfc0d0>
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_656f3b33a3d93238c01f10a9bd07bf93.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_656f3b33a3d93238c01f10a9bd07bf93.jpg saved to cache
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd5b790>
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_1b07142045b5c920d5892b636feb86fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_1b07142045b5c920d5892b636feb86fb.jpg saved to cache
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb61550>
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5b%252F44%252F5b445f989cc33c4cf8acdb0e51f531ff%252Fpa%252FNC58057_6d90f7f38048470124bf5027348288d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_6d90f7f38048470124bf5027348288d8.jpg saved to cache
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61
2026-03-28 18:39:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61, skipping ID generation
2026-03-28 18:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with scrape type 1
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 sending to next pipeline
2026-03-28 18:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61, identifier: NC58057
2026-03-28 18:39:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b204850>
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_100f2c73b4b1bf35df34ae788c00a019.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_100f2c73b4b1bf35df34ae788c00a019.jpg saved to cache
2026-03-28 18:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with identifier: NC58057
2026-03-28 18:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with identifier: NC58057
2026-03-28 18:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a36fa4d-7c8d-571d-97c1-c9eed649ec61 with identifier: NC58057 to the API
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_6d90f7f38048470124bf5027348288d8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 205,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:00:59Z',
 'fuel_type': 'diesel',
 'id': '9a36fa4d-7c8d-571d-97c1-c9eed649ec61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC58057',
 'listing': 'auction',
 'location': 'DE, Tradein',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 86541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85468,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_eb86c960a559870be321e917bd38be3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_6d90f7f38048470124bf5027348288d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_7ba3764a0cbd71b867e68610afd75c35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_d015f9caf29a378f9eb4ea66ee979958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_3b196fa5774b5d40ef7865114455c582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3319219,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_8a519f28c2b2464b0307c6b38137367e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_03b71c7bd887c808074e310850ef716d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_7fdd77082608baabe694aeae73a9cffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_bdeba89e2bdac5a6a267b0b85528f801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a36fa4d-7c8d-571d-97c1-c9eed649ec61/9a36fa4d-7c8d-571d-97c1-c9eed649ec61_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88704,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5b/44/5b445f989cc33c4cf8acdb0e51f531ff/pa/NC58057_0a2ad95e4fb0606cdb9d6c545ac731e9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI GSi 4x4',
 'transmission': 'automatic',
 'trim': 'GSi 4x4',
 'year': 2019}
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC58057%27 HTTP/1.1" 200 None
2026-03-28 18:39:21 [auto1.de] INFO: Saving data for NC58057: {'created_time': 1774723161.314941, 'last_price_update_time': 1774723161.314954, 'auction_closing_time': 1774882859.0}
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC58057') HTTP/1.1" 204 0
2026-03-28 18:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_1fce3ab18395cf84633ac11b4b72bcfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb604d0>
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_24795868498e53570c0a3a2aefadd24b.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_24795868498e53570c0a3a2aefadd24b.jpg saved to cache
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdd8690>
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_772d4a1af57d5f6da6243f80d26eaf38.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_772d4a1af57d5f6da6243f80d26eaf38.jpg saved to cache
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be45f90>
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_211008513d886bcd2a0bfa98d64fe8c1.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_211008513d886bcd2a0bfa98d64fe8c1.jpg saved to cache
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb3c10>
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_1fce3ab18395cf84633ac11b4b72bcfa.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_1fce3ab18395cf84633ac11b4b72bcfa.jpg saved to cache
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_21745d4d6078a74a3f3bdb479815fbaa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_a0dc53952a27b34632f56483cb4dc8d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_bc52018f105bf8f54bf81a3c046e820d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_efb9c72bbd16c94b69a3ccc5dd64037f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb32e10>
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_21745d4d6078a74a3f3bdb479815fbaa.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_21745d4d6078a74a3f3bdb479815fbaa.jpg saved to cache
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb68550>
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_a0dc53952a27b34632f56483cb4dc8d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_a0dc53952a27b34632f56483cb4dc8d7.jpg saved to cache
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb6a10>
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_bc52018f105bf8f54bf81a3c046e820d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_bc52018f105bf8f54bf81a3c046e820d.jpg saved to cache
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb4650>
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F6d%252F436d6afd4c2fa26b601cdefd2bc24921%252Fpa%252FYR75150_efb9c72bbd16c94b69a3ccc5dd64037f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_efb9c72bbd16c94b69a3ccc5dd64037f.jpg saved to cache
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77
2026-03-28 18:39:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e18fad0-1376-5345-ac5b-7c55b77ccb77, skipping ID generation
2026-03-28 18:39:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with scrape type 1
2026-03-28 18:39:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e18fad0-1376-5345-ac5b-7c55b77ccb77 sending to next pipeline
2026-03-28 18:39:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e18fad0-1376-5345-ac5b-7c55b77ccb77, identifier: YR75150
2026-03-28 18:39:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with identifier: YR75150
2026-03-28 18:39:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with identifier: YR75150
2026-03-28 18:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e18fad0-1376-5345-ac5b-7c55b77ccb77 with identifier: YR75150 to the API
2026-03-28 18:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_efb9c72bbd16c94b69a3ccc5dd64037f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:38:21Z',
 'fuel_type': 'petrol',
 'id': '8e18fad0-1376-5345-ac5b-7c55b77ccb77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR75150',
 'listing': 'auction',
 'location': 'DE, Sulzbach-Rosenberg',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 153087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325789,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_efb9c72bbd16c94b69a3ccc5dd64037f.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_cc628949a571cb2d799c8f2701cdc341.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_a0dc53952a27b34632f56483cb4dc8d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_bc52018f105bf8f54bf81a3c046e820d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_f07874ad39210b30097fb0e57b27164f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 297646,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_1fce3ab18395cf84633ac11b4b72bcfa.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 254125,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_1b07142045b5c920d5892b636feb86fb.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 326533,
             'Height': 900,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_100f2c73b4b1bf35df34ae788c00a019.jpg',
             'Width': 1200},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_5cba1ffccc3eaa5fdaf79d0b88fb2f24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e18fad0-1376-5345-ac5b-7c55b77ccb77/8e18fad0-1376-5345-ac5b-7c55b77ccb77_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63299,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/6d/436d6afd4c2fa26b601cdefd2bc24921/pa/YR75150_d1acdabe0ed7434bba0847022e00b4c4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75150%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [auto1.de] INFO: Saving data for YR75150: {'created_time': 1774723163.279956, 'last_price_update_time': 1774723163.279969, 'auction_closing_time': 1774885101.0}
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR75150') HTTP/1.1" 204 0
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_ba2d440bcd3b9ef164f6d4458c77cf1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_4a823dbc5cf2c138a3d9b32183c5d182.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_5f73a68ad745f21039ccf68363593e66.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR29597/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS35557> (referer: https://www.auto1.com/v1/car-details-view/NS35557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT01381/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX19467> (referer: https://www.auto1.com/v1/car-details-view/ZX19467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8f975d33d171f4e1c6e7f476b1cdcb37.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_7a863d2365aac159b553527b47b80529.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_f45df5967b411fec0ee4796e97888478.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_e71159a3a3c8cecd279692149f6e8401.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_66ab6be47152ceaf7c884b8409bac408.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_4c9ce1ea5076e50b4efc354ba060725f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdbd090>
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_ba2d440bcd3b9ef164f6d4458c77cf1d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_ba2d440bcd3b9ef164f6d4458c77cf1d.jpg saved to cache
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b008e50>
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_4a823dbc5cf2c138a3d9b32183c5d182.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_4a823dbc5cf2c138a3d9b32183c5d182.jpg saved to cache
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb06390>
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_5f73a68ad745f21039ccf68363593e66.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_5f73a68ad745f21039ccf68363593e66.jpg saved to cache
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with identifier: NS35557
2026-03-28 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with scrape type 1
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_5f231bb44afdd1d9f12535f2900cc647.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_5f231bb44afdd1d9f12535f2900cc647.jpg not downloaded yet
2026-03-28 18:39:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with identifier: ZX19467
2026-03-28 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with scrape type 1
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_70544931d079f3934e2122756da984c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_70544931d079f3934e2122756da984c0.jpg not downloaded yet
2026-03-28 18:39:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be686d0>
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F14%252F711436072056e3a6f0ab3aad90d3b292%252Fpa%252FKK21790_8f975d33d171f4e1c6e7f476b1cdcb37.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8f975d33d171f4e1c6e7f476b1cdcb37.jpg saved to cache
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbe07466-0fc4-5269-9979-5ea0279ff55d
2026-03-28 18:39:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbe07466-0fc4-5269-9979-5ea0279ff55d, skipping ID generation
2026-03-28 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe07466-0fc4-5269-9979-5ea0279ff55d with scrape type 1
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbe07466-0fc4-5269-9979-5ea0279ff55d sending to next pipeline
2026-03-28 18:39:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbe07466-0fc4-5269-9979-5ea0279ff55d, identifier: KK21790
2026-03-28 18:39:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd79210>
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_7a863d2365aac159b553527b47b80529.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_7a863d2365aac159b553527b47b80529.jpg saved to cache
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb3c710>
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252Fe1%252F8ae111014f06c5d15d6be48fc1e44cd2%252Fpa%252FCY46145_f45df5967b411fec0ee4796e97888478.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_f45df5967b411fec0ee4796e97888478.jpg saved to cache
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4
2026-03-28 18:39:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c24ca72-b933-536f-8cbd-b6c26b1561e4, skipping ID generation
2026-03-28 18:39:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with scrape type 1
2026-03-28 18:39:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c24ca72-b933-536f-8cbd-b6c26b1561e4 sending to next pipeline
2026-03-28 18:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c24ca72-b933-536f-8cbd-b6c26b1561e4, identifier: CY46145
2026-03-28 18:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b0390>
2026-03-28 18:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252F6d%252F536dbc48ed806219b2f1e9bdc8e681cb%252Fpa%252FTP97389_e71159a3a3c8cecd279692149f6e8401.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_e71159a3a3c8cecd279692149f6e8401.jpg saved to cache
2026-03-28 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503
2026-03-28 18:39:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503, skipping ID generation
2026-03-28 18:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with scrape type 1
2026-03-28 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 sending to next pipeline
2026-03-28 18:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503, identifier: TP97389
2026-03-28 18:39:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2f8090>
2026-03-28 18:39:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_66ab6be47152ceaf7c884b8409bac408.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_66ab6be47152ceaf7c884b8409bac408.jpg saved to cache
2026-03-28 18:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbe07466-0fc4-5269-9979-5ea0279ff55d with identifier: KK21790
2026-03-28 18:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbe07466-0fc4-5269-9979-5ea0279ff55d with identifier: KK21790
2026-03-28 18:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbe07466-0fc4-5269-9979-5ea0279ff55d with identifier: KK21790 to the API
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8f975d33d171f4e1c6e7f476b1cdcb37.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:20:34Z',
 'fuel_type': 'diesel',
 'id': 'bbe07466-0fc4-5269-9979-5ea0279ff55d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK21790',
 'listing': 'auction',
 'location': 'DE, Landsberg am Lech',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 198769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_772d4a1af57d5f6da6243f80d26eaf38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_fb315e800074cf1c55178c6ec39d8994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589935,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8f975d33d171f4e1c6e7f476b1cdcb37.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_6db3def69536d784023545c3f1fbd8c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8a7a241ef0a9d29de849fe1ee491bab6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_72eead01d2e4b9521a8f55ba4663a1ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_8486e50734e939a645c93d5910a1b3b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_4c7b89a383e46184817f911e1949b9a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_61419b45da3ba9ba88fa8519093bc747.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bbe07466-0fc4-5269-9979-5ea0279ff55d/bbe07466-0fc4-5269-9979-5ea0279ff55d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/14/711436072056e3a6f0ab3aad90d3b292/pa/KK21790_2dc4932333ef5e87327fe76f02b01820.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2017}
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK21790%27 HTTP/1.1" 200 None
2026-03-28 18:39:24 [auto1.de] INFO: Saving data for KK21790: {'created_time': 1774723164.788591, 'last_price_update_time': 1774723164.788604, 'auction_closing_time': 1774884034.0}
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK21790') HTTP/1.1" 204 0
2026-03-28 18:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with identifier: CY46145
2026-03-28 18:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with identifier: CY46145
2026-03-28 18:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c24ca72-b933-536f-8cbd-b6c26b1561e4 with identifier: CY46145 to the API
2026-03-28 18:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_f45df5967b411fec0ee4796e97888478.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:59:08Z',
 'fuel_type': 'diesel',
 'id': '9c24ca72-b933-536f-8cbd-b6c26b1561e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY46145',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 128169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_24795868498e53570c0a3a2aefadd24b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2912853,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_f45df5967b411fec0ee4796e97888478.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2828131,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_7a863d2365aac159b553527b47b80529.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_9c819d2ee09bd2baa7271b1745446beb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_656f3b33a3d93238c01f10a9bd07bf93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_bd951a880cb45d90b70dccd2cdcf01c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2876683,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_83fa68e28f070e93a658d98a4138712e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74413,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_8840d5155214b60716c1bff54040c6e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_5a53d191650ab2bb8ee2a7a5643b7f86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c24ca72-b933-536f-8cbd-b6c26b1561e4/9c24ca72-b933-536f-8cbd-b6c26b1561e4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/e1/8ae111014f06c5d15d6be48fc1e44cd2/pa/CY46145_cbd72a3c03feb24a596f6aa7d0e6d275.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-3 1.5 Diesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2017}
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY46145%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Saving data for CY46145: {'created_time': 1774723166.112485, 'last_price_update_time': 1774723166.112496, 'auction_closing_time': 1774886348.0}
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY46145') HTTP/1.1" 204 0
2026-03-28 18:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with identifier: TP97389
2026-03-28 18:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with identifier: TP97389
2026-03-28 18:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2532fc7-7fd5-587b-9ddd-7a98a8e5a503 with identifier: TP97389 to the API
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_e71159a3a3c8cecd279692149f6e8401.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'petrol',
 'id': 'd2532fc7-7fd5-587b-9ddd-7a98a8e5a503',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP97389',
 'listing': 'auction',
 'location': 'DE, Lübeck',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 88866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3040239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_4f8e2a20bee8e0b60f34d4ccaf3f3d1f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_ecdeda81c15bad95a0f5f92fbb2b26e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2851508,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_40a6133d3fe8c6fbd839e529c8a885c2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2867381,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_2227282adfa12bdc792c8f99552dfa23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_7bcbb2763c7b225d8f9868a167eec94f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_0ae0da785d697fd080511382c64704ef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_21745d4d6078a74a3f3bdb479815fbaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2905087,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_e71159a3a3c8cecd279692149f6e8401.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_211008513d886bcd2a0bfa98d64fe8c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2532fc7-7fd5-587b-9ddd-7a98a8e5a503/d2532fc7-7fd5-587b-9ddd-7a98a8e5a503_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img53/6d/536dbc48ed806219b2f1e9bdc8e681cb/pa/TP97389_aa30b0cf1676888f4058cd75d9640d1e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP97389%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [auto1.de] INFO: Saving data for TP97389: {'created_time': 1774723166.517097, 'last_price_update_time': 1774723166.517108, 'auction_closing_time': 1774884844.0}
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP97389') HTTP/1.1" 204 0
2026-03-28 18:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_5ff1e9b1365df036ab7cfac77e378760.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_240f0c6420114214658bebc4acb098fc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_a608fd3f1759693e101c347b203eae3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_a608fd3f1759693e101c347b203eae3f.jpg not downloaded yet
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_bda51496ea93a1f8c2e93cb5df523b98.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_bda51496ea93a1f8c2e93cb5df523b98.jpg not downloaded yet
2026-03-28 18:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_428395e95a2a9a676b68aa0f8f056349.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA36470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA51516/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_3b33badbed62b531ff39e7856420c6cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_3b33badbed62b531ff39e7856420c6cb.jpg not downloaded yet
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_73383d5431b0b4160f169deb7c87d8db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_73383d5431b0b4160f169deb7c87d8db.jpg not downloaded yet
2026-03-28 18:39:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd89c90>
2026-03-28 18:39:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252F14%252F231493b2cc4366b0841e9c3df34a2e31%252Fpa%252FGJ18953_4c9ce1ea5076e50b4efc354ba060725f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_4c9ce1ea5076e50b4efc354ba060725f.jpg saved to cache
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 392ce6f0-1e5b-5695-8f94-a24c39110444
2026-03-28 18:39:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 392ce6f0-1e5b-5695-8f94-a24c39110444, skipping ID generation
2026-03-28 18:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 392ce6f0-1e5b-5695-8f94-a24c39110444 with scrape type 1
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 392ce6f0-1e5b-5695-8f94-a24c39110444 sending to next pipeline
2026-03-28 18:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 392ce6f0-1e5b-5695-8f94-a24c39110444, identifier: GJ18953
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_cf2f775ae99af4cd104243ac8af91157.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_cf2f775ae99af4cd104243ac8af91157.jpg not downloaded yet
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_93b087b48ccceade7cbf4d2171e4afba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_93b087b48ccceade7cbf4d2171e4afba.jpg not downloaded yet
2026-03-28 18:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 392ce6f0-1e5b-5695-8f94-a24c39110444 with identifier: GJ18953
2026-03-28 18:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 392ce6f0-1e5b-5695-8f94-a24c39110444 with identifier: GJ18953
2026-03-28 18:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 392ce6f0-1e5b-5695-8f94-a24c39110444 with identifier: GJ18953 to the API
2026-03-28 18:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_4c9ce1ea5076e50b4efc354ba060725f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:36:22Z',
 'fuel_type': 'petrol',
 'id': '392ce6f0-1e5b-5695-8f94-a24c39110444',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ18953',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 75421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_177c00481cab5331d78e3f7bbd6baf19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_4c9ce1ea5076e50b4efc354ba060725f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_92876aa53e9ca8e6807bcbddf1ba6abc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_b899a5f688028251cc677fa875260b5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_392ce6f0-1e5b-5695-8f94-a24c39110444/392ce6f0-1e5b-5695-8f94-a24c39110444_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/14/231493b2cc4366b0841e9c3df34a2e31/pa/GJ18953_7911dc32994eb2944845712b0b39f50f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-03-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2009}
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ18953%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [auto1.de] INFO: Saving data for GJ18953: {'created_time': 1774723167.195632, 'last_price_update_time': 1774723167.195643, 'auction_closing_time': 1774884982.0}
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ18953') HTTP/1.1" 204 0
2026-03-28 18:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb5f050>
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_5ff1e9b1365df036ab7cfac77e378760.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_5ff1e9b1365df036ab7cfac77e378760.jpg saved to cache
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd8b110>
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_240f0c6420114214658bebc4acb098fc.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_240f0c6420114214658bebc4acb098fc.jpg saved to cache
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbcd410>
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_428395e95a2a9a676b68aa0f8f056349.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_428395e95a2a9a676b68aa0f8f056349.jpg saved to cache
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_7b66e1206f7fc8fd19f1de8524f7ab2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_7b66e1206f7fc8fd19f1de8524f7ab2d.jpg not downloaded yet
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_fbd1724ee1517cdd42756129b3cd8204.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_fbd1724ee1517cdd42756129b3cd8204.jpg not downloaded yet
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV45930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_e5204145fae36a5a55b9765b42493517.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_e5204145fae36a5a55b9765b42493517.jpg not downloaded yet
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ20117/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK93923> (referer: https://www.auto1.com/v1/car-details-view/TK93923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_70544931d079f3934e2122756da984c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_7b56085513fd44a658c797dd9376aef4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_7b56085513fd44a658c797dd9376aef4.jpg not downloaded yet
2026-03-28 18:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_73383d5431b0b4160f169deb7c87d8db.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_29544507914cf5b98eaf78619e187c0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_29544507914cf5b98eaf78619e187c0b.jpg not downloaded yet
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_1cc6b4b176c23e1a5f50ef240d4e72a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_1cc6b4b176c23e1a5f50ef240d4e72a4.jpg not downloaded yet
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_889e9f30bc2cc2c80df419132fcbce2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_889e9f30bc2cc2c80df419132fcbce2d.jpg not downloaded yet
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_5f231bb44afdd1d9f12535f2900cc647.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9549a418e210f6ca90fd892926c1faa8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_8cfc597f0b891bba0106069112986f5a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_c64053322bcac66cf7190b868eae85d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with identifier: TK93923
2026-03-28 18:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with scrape type 1
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_1cf4db1b239ced3cea8ba342e546bf92.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_1cf4db1b239ced3cea8ba342e546bf92.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_c398329854620915b466d3381ef0f9a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_c398329854620915b466d3381ef0f9a1.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_02057eaaf86d2e0b969a9777df861b2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_02057eaaf86d2e0b969a9777df861b2d.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_98c096eb54df244a06381b1bd393eb11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_98c096eb54df244a06381b1bd393eb11.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_07f485b981377024ee7569b30b68baa8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_07f485b981377024ee7569b30b68baa8.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_d759cef8cd29a97f944457a53809a077.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_d759cef8cd29a97f944457a53809a077.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_eb37efa7c50f036fa68b70d2f3e0d03a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_eb37efa7c50f036fa68b70d2f3e0d03a.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_1721d7c4516ff714c8b7b867f6c2c6d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_1721d7c4516ff714c8b7b867f6c2c6d6.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_76b181b0667c8c7e0d398b8ead915717.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_76b181b0667c8c7e0d398b8ead915717.jpg already downloaded
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252Fbc%252F98bc1f6f143acca8e835b234a31719bf%252Fpa%252FTK93923_bc7611c9cb8af9c44dece0e035479bca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_bc7611c9cb8af9c44dece0e035479bca.jpg already downloaded
2026-03-28 18:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc, identifier: TK93923
2026-03-28 18:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with identifier: TK93923
2026-03-28 18:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with identifier: TK93923
2026-03-28 18:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e339f6c-e99e-53ba-9288-4b2cbb8e57fc with identifier: TK93923 to the API
2026-03-28 18:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK93923>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:46:33Z',
 'fuel_type': 'diesel',
 'id': '5e339f6c-e99e-53ba-9288-4b2cbb8e57fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK93923',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 145325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_1cf4db1b239ced3cea8ba342e546bf92.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_c398329854620915b466d3381ef0f9a1.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_02057eaaf86d2e0b969a9777df861b2d.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_98c096eb54df244a06381b1bd393eb11.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_07f485b981377024ee7569b30b68baa8.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_d759cef8cd29a97f944457a53809a077.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_eb37efa7c50f036fa68b70d2f3e0d03a.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_1721d7c4516ff714c8b7b867f6c2c6d6.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_76b181b0667c8c7e0d398b8ead915717.jpg',
                'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_bc7611c9cb8af9c44dece0e035479bca.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90220,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_1cf4db1b239ced3cea8ba342e546bf92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_c398329854620915b466d3381ef0f9a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_02057eaaf86d2e0b969a9777df861b2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_98c096eb54df244a06381b1bd393eb11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_07f485b981377024ee7569b30b68baa8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_d759cef8cd29a97f944457a53809a077.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_eb37efa7c50f036fa68b70d2f3e0d03a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_1721d7c4516ff714c8b7b867f6c2c6d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83127,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_76b181b0667c8c7e0d398b8ead915717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e339f6c-e99e-53ba-9288-4b2cbb8e57fc/5e339f6c-e99e-53ba-9288-4b2cbb8e57fc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/bc/98bc1f6f143acca8e835b234a31719bf/pa/TK93923_bc7611c9cb8af9c44dece0e035479bca.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK93923%27 HTTP/1.1" 200 None
2026-03-28 18:39:28 [auto1.de] INFO: Saving data for TK93923: {'created_time': 1774723168.126663, 'last_price_update_time': 1774723168.126674, 'auction_closing_time': 1774885593.0}
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK93923') HTTP/1.1" 204 0
2026-03-28 18:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_a608fd3f1759693e101c347b203eae3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b026fd0>
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_70544931d079f3934e2122756da984c0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_70544931d079f3934e2122756da984c0.jpg saved to cache
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8
2026-03-28 18:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_bda51496ea93a1f8c2e93cb5df523b98.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_579dad020708aab297f8c8e7ee989ccb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_fbd1724ee1517cdd42756129b3cd8204.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd56350>
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_73383d5431b0b4160f169deb7c87d8db.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_73383d5431b0b4160f169deb7c87d8db.jpg saved to cache
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd50f10>
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_5f231bb44afdd1d9f12535f2900cc647.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_5f231bb44afdd1d9f12535f2900cc647.jpg saved to cache
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02f490>
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_9549a418e210f6ca90fd892926c1faa8.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9549a418e210f6ca90fd892926c1faa8.jpg saved to cache
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcd4190>
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg66%252F0b%252F660b078f96d1abc7838c1e46c11dbc5e%252Fpa%252FGR83992_8cfc597f0b891bba0106069112986f5a.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_8cfc597f0b891bba0106069112986f5a.jpg saved to cache
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5
2026-03-28 18:39:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5, skipping ID generation
2026-03-28 18:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with scrape type 1
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 sending to next pipeline
2026-03-28 18:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5, identifier: GR83992
2026-03-28 18:39:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcf0950>
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_c64053322bcac66cf7190b868eae85d0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_c64053322bcac66cf7190b868eae85d0.jpg saved to cache
2026-03-28 18:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with identifier: GR83992
2026-03-28 18:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with identifier: GR83992
2026-03-28 18:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5 with identifier: GR83992 to the API
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_8cfc597f0b891bba0106069112986f5a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:00:55Z',
 'fuel_type': 'diesel',
 'id': '6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR83992',
 'listing': 'auction',
 'location': 'DE, Mülheim\xad-Kärlich',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 168105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2818651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_8cfc597f0b891bba0106069112986f5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_602aa21aa6ce612d49dc40c05127af9b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75463,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_b16bfacbd5198042bc3b89e6a722bb34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_4a823dbc5cf2c138a3d9b32183c5d182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_5f73a68ad745f21039ccf68363593e66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2645929,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_41490b2b52debc9ea7334f476830fa70.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_ce7dd765d211026caaa62cece785c007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2652712,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_7e6bc4b74d9b3d8426a47c69ac46e48d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578845,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_e77647c2fac5500bf7759d7cb75335ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5/6b0c17d7-10ce-5cbe-ae91-2d4953caf8b5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img66/0b/660b078f96d1abc7838c1e46c11dbc5e/pa/GR83992_77ffc136148c1c63e5178335aadd627c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2019}
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR83992%27 HTTP/1.1" 200 None
2026-03-28 18:39:29 [auto1.de] INFO: Saving data for GR83992: {'created_time': 1774723169.102785, 'last_price_update_time': 1774723169.102804, 'auction_closing_time': 1774882855.0}
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR83992') HTTP/1.1" 204 0
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_1cc6b4b176c23e1a5f50ef240d4e72a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a609c10>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_a608fd3f1759693e101c347b203eae3f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_a608fd3f1759693e101c347b203eae3f.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb579d0>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_bda51496ea93a1f8c2e93cb5df523b98.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_bda51496ea93a1f8c2e93cb5df523b98.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beff310>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_579dad020708aab297f8c8e7ee989ccb.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_579dad020708aab297f8c8e7ee989ccb.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26cc90>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_fbd1724ee1517cdd42756129b3cd8204.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_fbd1724ee1517cdd42756129b3cd8204.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8
2026-03-28 18:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a36bc10>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_1cc6b4b176c23e1a5f50ef240d4e72a4.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_1cc6b4b176c23e1a5f50ef240d4e72a4.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_3b33badbed62b531ff39e7856420c6cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_e223374f4ff828ab347268ce7da6acad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_e5204145fae36a5a55b9765b42493517.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_7b66e1206f7fc8fd19f1de8524f7ab2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc02310>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_3b33badbed62b531ff39e7856420c6cb.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_3b33badbed62b531ff39e7856420c6cb.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_889e9f30bc2cc2c80df419132fcbce2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_29544507914cf5b98eaf78619e187c0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_93b087b48ccceade7cbf4d2171e4afba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beac710>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_e223374f4ff828ab347268ce7da6acad.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_e223374f4ff828ab347268ce7da6acad.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b285690>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_e5204145fae36a5a55b9765b42493517.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_e5204145fae36a5a55b9765b42493517.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10f610>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_7b66e1206f7fc8fd19f1de8524f7ab2d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_7b66e1206f7fc8fd19f1de8524f7ab2d.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA36470> (referer: https://www.auto1.com/v1/car-details-view/YA36470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR29597> (referer: https://www.auto1.com/v1/car-details-view/VR29597/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA51516> (referer: https://www.auto1.com/v1/car-details-view/WA51516/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b215850>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_889e9f30bc2cc2c80df419132fcbce2d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_889e9f30bc2cc2c80df419132fcbce2d.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b106610>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_29544507914cf5b98eaf78619e187c0b.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_29544507914cf5b98eaf78619e187c0b.jpg saved to cache
2026-03-28 18:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0290d0>
2026-03-28 18:39:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F73%252F8873b14448cd4ff857de262fba42b36b%252Fpa%252FZX19467_93b087b48ccceade7cbf4d2171e4afba.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_93b087b48ccceade7cbf4d2171e4afba.jpg saved to cache
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8
2026-03-28 18:39:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8, skipping ID generation
2026-03-28 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with scrape type 1
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 sending to next pipeline
2026-03-28 18:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8, identifier: ZX19467
2026-03-28 18:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with identifier: ZX19467
2026-03-28 18:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with identifier: ZX19467
2026-03-28 18:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f26ae16-61d2-5d69-954e-8761dd2ee8c8 with identifier: ZX19467 to the API
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_93b087b48ccceade7cbf4d2171e4afba.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.7L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:45:47Z',
 'fuel_type': 'diesel',
 'id': '3f26ae16-61d2-5d69-954e-8761dd2ee8c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX19467',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 288606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_70544931d079f3934e2122756da984c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_bda51496ea93a1f8c2e93cb5df523b98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_73383d5431b0b4160f169deb7c87d8db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_93b087b48ccceade7cbf4d2171e4afba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f26ae16-61d2-5d69-954e-8761dd2ee8c8/3f26ae16-61d2-5d69-954e-8761dd2ee8c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/73/8873b14448cd4ff857de262fba42b36b/pa/ZX19467_fbd1724ee1517cdd42756129b3cd8204.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX19467%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [auto1.de] INFO: Saving data for ZX19467: {'created_time': 1774723170.556902, 'last_price_update_time': 1774723170.556917, 'auction_closing_time': 1774885547.0}
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX19467') HTTP/1.1" 204 0
2026-03-28 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT01381> (referer: https://www.auto1.com/v1/car-details-view/LT01381/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG52031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_38b67fc972d3c4fa1b60c3938c1b8ccf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_05178aeb03ce03a978c0255d089ffd76.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_1f1a181f140fa65f1bc1127b9e7e13da.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV45930> (referer: https://www.auto1.com/v1/car-details-view/TV45930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ20117> (referer: https://www.auto1.com/v1/car-details-view/DZ20117/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with identifier: YA36470
2026-03-28 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with scrape type 1
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_8da8100b6b098d343aa90d76c420f702.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8da8100b6b098d343aa90d76c420f702.jpg not downloaded yet
2026-03-28 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bfce597-aa07-525a-9379-4a3e07dff8cd with identifier: VR29597
2026-03-28 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfce597-aa07-525a-9379-4a3e07dff8cd with scrape type 1
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2bfce597-aa07-525a-9379-4a3e07dff8cd
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_d79eb2efa73a57e6f50325288d78824a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_d79eb2efa73a57e6f50325288d78824a.jpg not downloaded yet
2026-03-28 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cacc695-7706-51bc-b762-2927968f0f61 with identifier: WA51516
2026-03-28 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cacc695-7706-51bc-b762-2927968f0f61 with scrape type 1
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5cacc695-7706-51bc-b762-2927968f0f61
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_6f9bf7e02a07858d0b080904e881e6fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_6f9bf7e02a07858d0b080904e881e6fa.jpg not downloaded yet
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_8475d97cf281f91c2bde975e579a5f81.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8475d97cf281f91c2bde975e579a5f81.jpg not downloaded yet
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_4890c4e6875587a4aba2118a40aba337.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_4890c4e6875587a4aba2118a40aba337.jpg not downloaded yet
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_98acae30d6f652d2c7ba6e928caa4ead.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_98acae30d6f652d2c7ba6e928caa4ead.jpg not downloaded yet
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_ba1df923e0afcbdf6bca8286ed463e42.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_ba1df923e0afcbdf6bca8286ed463e42.jpg not downloaded yet
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_7272babbde4409b2842cab8c940606fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_7272babbde4409b2842cab8c940606fb.jpg not downloaded yet
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_9127d34317d3801b4a167ff3d1811f6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_9127d34317d3801b4a167ff3d1811f6f.jpg not downloaded yet
2026-03-28 18:39:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_64de150f9bca58460ef84939e819ee22.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with identifier: LT01381
2026-03-28 18:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with scrape type 1
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_f2e83f42b7d508d9e7e3b1820081d5a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_f2e83f42b7d508d9e7e3b1820081d5a2.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_6f667b41375682880c80089ad36cc5a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6f667b41375682880c80089ad36cc5a9.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_d1fb545df7367466a836608e721348f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_d1fb545df7367466a836608e721348f0.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_394cad363c6ff326cafea19e0dc85c53.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_394cad363c6ff326cafea19e0dc85c53.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_fab17ba0109d9e6974d6cd077b5a759a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_fab17ba0109d9e6974d6cd077b5a759a.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_4e90e629a0fbe6dac32852f489c33e80.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_4e90e629a0fbe6dac32852f489c33e80.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_a142302c0e1c48ed2f44381d5cf71c57.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_a142302c0e1c48ed2f44381d5cf71c57.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_6b329024d37b0d610d3360f42b7bfbdf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6b329024d37b0d610d3360f42b7bfbdf.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_6e33100bad5b2d4ba710b35655557ee1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6e33100bad5b2d4ba710b35655557ee1.jpg already downloaded
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg27%252F42%252F274228e8e5bacbf55ebdfe6bda813c60%252Fpa%252FLT01381_2b553b74de3d32109a64d11fb97359f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_2b553b74de3d32109a64d11fb97359f1.jpg already downloaded
2026-03-28 18:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be, identifier: LT01381
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b014910>
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg69%252F91%252F6991825c09b0fd66d039f0f5a07d1904%252Fpa%252FFD40697_38b67fc972d3c4fa1b60c3938c1b8ccf.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_38b67fc972d3c4fa1b60c3938c1b8ccf.jpg saved to cache
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 532327ad-702b-5c8b-9114-da01ba67ec6a
2026-03-28 18:39:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 532327ad-702b-5c8b-9114-da01ba67ec6a, skipping ID generation
2026-03-28 18:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 532327ad-702b-5c8b-9114-da01ba67ec6a with scrape type 1
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 532327ad-702b-5c8b-9114-da01ba67ec6a sending to next pipeline
2026-03-28 18:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 532327ad-702b-5c8b-9114-da01ba67ec6a, identifier: FD40697
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2639d0>
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_05178aeb03ce03a978c0255d089ffd76.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_05178aeb03ce03a978c0255d089ffd76.jpg saved to cache
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d5bc90>
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_1f1a181f140fa65f1bc1127b9e7e13da.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_1f1a181f140fa65f1bc1127b9e7e13da.jpg saved to cache
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with identifier: TV45930
2026-03-28 18:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with scrape type 1
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4046d8ea-80e9-52f3-8d98-06dca29c5a7a
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_76e3ba913a76df3159508d2b3fa1f284.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_76e3ba913a76df3159508d2b3fa1f284.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_1bac2f6a1bae24ca7417d9fa910e49af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_1bac2f6a1bae24ca7417d9fa910e49af.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_c7ba35170432d28e3646e1d055d6557c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_c7ba35170432d28e3646e1d055d6557c.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_371fc80eb7fc9bb65faccdd0a9f98119.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_371fc80eb7fc9bb65faccdd0a9f98119.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_cf74e0b2e05f2815f519f6741ccdc671.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_cf74e0b2e05f2815f519f6741ccdc671.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_75d3ee7c140be2a8491c337c397476d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_75d3ee7c140be2a8491c337c397476d5.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_117e2268f3bf16e0b441f3944e12aa43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_117e2268f3bf16e0b441f3944e12aa43.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_5f89de5a6858e3be241d8c72b66f3c55.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_5f89de5a6858e3be241d8c72b66f3c55.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_7bd8cba7b72dc00aa0ae005eedb0c591.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_7bd8cba7b72dc00aa0ae005eedb0c591.jpg already downloaded
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2f%252F83%252F2f83e8f67eac7cc959f6a6e26fcfafc2%252Fpa%252FTV45930_dcc55d9d864d62bbbb025cdaf53bfbf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_dcc55d9d864d62bbbb025cdaf53bfbf3.jpg already downloaded
2026-03-28 18:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a, identifier: TV45930
2026-03-28 18:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with identifier: DZ20117
2026-03-28 18:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with scrape type 1
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_ad32dfa87e27cf82230cdf54930150bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_ad32dfa87e27cf82230cdf54930150bd.jpg not downloaded yet
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_85a645501b780b5140df2d544d0bf34c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_85a645501b780b5140df2d544d0bf34c.jpg not downloaded yet
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_c4d1ea9a65caddbdc80aed9fcb7c6069.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_c4d1ea9a65caddbdc80aed9fcb7c6069.jpg not downloaded yet
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_24d9a9b86d5eb9bbf5d814c72d23db7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_24d9a9b86d5eb9bbf5d814c72d23db7d.jpg not downloaded yet
2026-03-28 18:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with identifier: LT01381
2026-03-28 18:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with identifier: LT01381
2026-03-28 18:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9bd0cde0-9912-584d-a0ae-f7dadeb5a3be with identifier: LT01381 to the API
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LT01381>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:21:51Z',
 'fuel_type': 'petrol',
 'id': '9bd0cde0-9912-584d-a0ae-f7dadeb5a3be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT01381',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 120667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_f2e83f42b7d508d9e7e3b1820081d5a2.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6f667b41375682880c80089ad36cc5a9.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_d1fb545df7367466a836608e721348f0.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_394cad363c6ff326cafea19e0dc85c53.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_fab17ba0109d9e6974d6cd077b5a759a.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_4e90e629a0fbe6dac32852f489c33e80.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_a142302c0e1c48ed2f44381d5cf71c57.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6b329024d37b0d610d3360f42b7bfbdf.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6e33100bad5b2d4ba710b35655557ee1.jpg',
                'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_2b553b74de3d32109a64d11fb97359f1.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_f2e83f42b7d508d9e7e3b1820081d5a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6f667b41375682880c80089ad36cc5a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2620278,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_d1fb545df7367466a836608e721348f0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2627311,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_394cad363c6ff326cafea19e0dc85c53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2335603,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_fab17ba0109d9e6974d6cd077b5a759a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2547896,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_4e90e629a0fbe6dac32852f489c33e80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2704535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_a142302c0e1c48ed2f44381d5cf71c57.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2525924,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6b329024d37b0d610d3360f42b7bfbdf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_6e33100bad5b2d4ba710b35655557ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9bd0cde0-9912-584d-a0ae-f7dadeb5a3be/9bd0cde0-9912-584d-a0ae-f7dadeb5a3be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img27/42/274228e8e5bacbf55ebdfe6bda813c60/pa/LT01381_2b553b74de3d32109a64d11fb97359f1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT01381%27 HTTP/1.1" 200 None
2026-03-28 18:39:32 [auto1.de] INFO: Saving data for LT01381: {'created_time': 1774723172.362027, 'last_price_update_time': 1774723172.362042, 'auction_closing_time': 1774884111.0}
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT01381') HTTP/1.1" 204 0
2026-03-28 18:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 532327ad-702b-5c8b-9114-da01ba67ec6a with identifier: FD40697
2026-03-28 18:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 532327ad-702b-5c8b-9114-da01ba67ec6a with identifier: FD40697
2026-03-28 18:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 532327ad-702b-5c8b-9114-da01ba67ec6a with identifier: FD40697 to the API
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_38b67fc972d3c4fa1b60c3938c1b8ccf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:12:36Z',
 'fuel_type': 'petrol',
 'id': '532327ad-702b-5c8b-9114-da01ba67ec6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD40697',
 'listing': 'auction',
 'location': 'DE, Kaufbeuren',
 'make': 'Mazda',
 'model': '2',
 'odometer': 28791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_38b67fc972d3c4fa1b60c3938c1b8ccf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_a7aca0729cf858a23678b41323cc1fa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_32fd853debc61edee4502211ca9d09a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2552488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_c64053322bcac66cf7190b868eae85d0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79721,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_24ec9766287807447b3490ce48a59315.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_428395e95a2a9a676b68aa0f8f056349.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2728462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_66ab6be47152ceaf7c884b8409bac408.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_07a985ad2c2565b2dceb96c925d29469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2512578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_336778a81acaa0f911965ed03bee110c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_532327ad-702b-5c8b-9114-da01ba67ec6a/532327ad-702b-5c8b-9114-da01ba67ec6a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img69/91/6991825c09b0fd66d039f0f5a07d1904/pa/FD40697_f103aea241a55727792ad8d3d09bdb3f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 2 1.5 Kizoku',
 'transmission': 'manual',
 'trim': 'Kizoku',
 'year': 2019}
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD40697%27 HTTP/1.1" 200 None
2026-03-28 18:39:32 [auto1.de] INFO: Saving data for FD40697: {'created_time': 1774723172.772274, 'last_price_update_time': 1774723172.772287, 'auction_closing_time': 1774883556.0}
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD40697') HTTP/1.1" 204 0
2026-03-28 18:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with identifier: TV45930
2026-03-28 18:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with identifier: TV45930
2026-03-28 18:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4046d8ea-80e9-52f3-8d98-06dca29c5a7a with identifier: TV45930 to the API
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TV45930>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:13:56Z',
 'fuel_type': 'diesel',
 'id': '4046d8ea-80e9-52f3-8d98-06dca29c5a7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV45930',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'BMW',
 'model': '1er',
 'odometer': 158458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_76e3ba913a76df3159508d2b3fa1f284.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_1bac2f6a1bae24ca7417d9fa910e49af.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_c7ba35170432d28e3646e1d055d6557c.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_371fc80eb7fc9bb65faccdd0a9f98119.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_cf74e0b2e05f2815f519f6741ccdc671.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_75d3ee7c140be2a8491c337c397476d5.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_117e2268f3bf16e0b441f3944e12aa43.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_5f89de5a6858e3be241d8c72b66f3c55.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_7bd8cba7b72dc00aa0ae005eedb0c591.jpg',
                'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_dcc55d9d864d62bbbb025cdaf53bfbf3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_76e3ba913a76df3159508d2b3fa1f284.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71729,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_1bac2f6a1bae24ca7417d9fa910e49af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_c7ba35170432d28e3646e1d055d6557c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_371fc80eb7fc9bb65faccdd0a9f98119.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_cf74e0b2e05f2815f519f6741ccdc671.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_75d3ee7c140be2a8491c337c397476d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56358,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_117e2268f3bf16e0b441f3944e12aa43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_5f89de5a6858e3be241d8c72b66f3c55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_7bd8cba7b72dc00aa0ae005eedb0c591.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4046d8ea-80e9-52f3-8d98-06dca29c5a7a/4046d8ea-80e9-52f3-8d98-06dca29c5a7a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60392,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2f/83/2f83e8f67eac7cc959f6a6e26fcfafc2/pa/TV45930_dcc55d9d864d62bbbb025cdaf53bfbf3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV45930%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [auto1.de] INFO: Saving data for TV45930: {'created_time': 1774723173.107617, 'last_price_update_time': 1774723173.107629, 'auction_closing_time': 1774883636.0}
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV45930') HTTP/1.1" 204 0
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_9931fcadd037feee480c14be129fedb2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_e4f1290f8a6fa5416e981bbea12f2351.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_e4f1290f8a6fa5416e981bbea12f2351.jpg not downloaded yet
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_8009120486e60996b5e53fac457b0c9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_90ec2b140a77c4ae5dfc05524f5724b4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_02b3fbe0cf4e0a1dacaaf60e78bbe63b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_02b3fbe0cf4e0a1dacaaf60e78bbe63b.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_90d0f92caba88f248d503e6df017847b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_90d0f92caba88f248d503e6df017847b.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_4cfb05111b0755c0c58f1ed27a463d22.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_4cfb05111b0755c0c58f1ed27a463d22.jpg not downloaded yet
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY42721/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_771755a6fcdeab5c400176ea54a74de7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_771755a6fcdeab5c400176ea54a74de7.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_f7b61460c32e98f8dcd255a270c46c65.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_f7b61460c32e98f8dcd255a270c46c65.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_f82ec6ee340633921d8b2ececd301a37.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_f82ec6ee340633921d8b2ececd301a37.jpg not downloaded yet
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beef1d0>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_64de150f9bca58460ef84939e819ee22.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_64de150f9bca58460ef84939e819ee22.jpg saved to cache
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_7b56085513fd44a658c797dd9376aef4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_f3df7288c241c2801f719dc3c1370e4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_f3df7288c241c2801f719dc3c1370e4d.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_b6084b249782d0dc77b8259419a5bd85.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_b6084b249782d0dc77b8259419a5bd85.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_2b5503a55eea89e1a72d85883d954f55.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_2b5503a55eea89e1a72d85883d954f55.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_f73940b7b18e9647361f867fa98d9e0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_f73940b7b18e9647361f867fa98d9e0d.jpg not downloaded yet
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_beac3eda8fdcf74629c4a44c5a13a682.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_181457cc94ea80bdb4fa1d51f9ee1881.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_181457cc94ea80bdb4fa1d51f9ee1881.jpg not downloaded yet
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be70f90>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_9931fcadd037feee480c14be129fedb2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_9931fcadd037feee480c14be129fedb2.jpg saved to cache
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf6190>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_8009120486e60996b5e53fac457b0c9a.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_8009120486e60996b5e53fac457b0c9a.jpg saved to cache
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8c0d0>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_90ec2b140a77c4ae5dfc05524f5724b4.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_90ec2b140a77c4ae5dfc05524f5724b4.jpg saved to cache
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_df046884922ec83e12f3fa581a7d0e0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_521f6690f5d1ce7ab4a987142e20a3fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_521f6690f5d1ce7ab4a987142e20a3fa.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_caa083093ec00f931daa2eecfee00717.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_caa083093ec00f931daa2eecfee00717.jpg not downloaded yet
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_d4622dad178759c71a63a2fefccb0e0e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_95293dc7fe59384e1252961c6d470691.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_dc7b4b52c53b21e14872b2461eb42653.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_dc7b4b52c53b21e14872b2461eb42653.jpg not downloaded yet
2026-03-28 18:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8cd10>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_7b56085513fd44a658c797dd9376aef4.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_7b56085513fd44a658c797dd9376aef4.jpg saved to cache
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf6d90>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_beac3eda8fdcf74629c4a44c5a13a682.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_beac3eda8fdcf74629c4a44c5a13a682.jpg saved to cache
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_4daf45a710b3bf4a27a7c88a8b469ac0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_4daf45a710b3bf4a27a7c88a8b469ac0.jpg not downloaded yet
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_b9b084051f6f091a7d27f5d1af6ba5e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_b9b084051f6f091a7d27f5d1af6ba5e3.jpg not downloaded yet
2026-03-28 18:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR24120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb9c150>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_df046884922ec83e12f3fa581a7d0e0b.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_df046884922ec83e12f3fa581a7d0e0b.jpg saved to cache
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b000ed0>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_d4622dad178759c71a63a2fefccb0e0e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_d4622dad178759c71a63a2fefccb0e0e.jpg saved to cache
2026-03-28 18:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb2f50>
2026-03-28 18:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_95293dc7fe59384e1252961c6d470691.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_95293dc7fe59384e1252961c6d470691.jpg saved to cache
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9f492fd02559e9d816226ebffd3dda1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_98acae30d6f652d2c7ba6e928caa4ead.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_cf2f775ae99af4cd104243ac8af91157.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_6b0cda588566c6cc329171ed56e7fc38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_6b0cda588566c6cc329171ed56e7fc38.jpg not downloaded yet
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_c4d1ea9a65caddbdc80aed9fcb7c6069.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_54b24147adc0e8133b03dc3217e516ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_24d9a9b86d5eb9bbf5d814c72d23db7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_ad32dfa87e27cf82230cdf54930150bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_7d01a6941a6af66e46018f4c69bb4ae2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_4cfb05111b0755c0c58f1ed27a463d22.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb52850>
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fb4%252F94b428d3cf3bad072a68b379650362b4%252Fpa%252FNZ79152_9f492fd02559e9d816226ebffd3dda1e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9f492fd02559e9d816226ebffd3dda1e.jpg saved to cache
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c
2026-03-28 18:39:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c, skipping ID generation
2026-03-28 18:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with scrape type 1
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c38c50e-0e07-51ec-bf59-7ab99493dc8c sending to next pipeline
2026-03-28 18:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c, identifier: NZ79152
2026-03-28 18:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with identifier: NZ79152
2026-03-28 18:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with identifier: NZ79152
2026-03-28 18:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c38c50e-0e07-51ec-bf59-7ab99493dc8c with identifier: NZ79152 to the API
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9f492fd02559e9d816226ebffd3dda1e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:53:57Z',
 'fuel_type': 'petrol',
 'id': '3c38c50e-0e07-51ec-bf59-7ab99493dc8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ79152',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 96674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66712,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_64de150f9bca58460ef84939e819ee22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_b4039d2f0c49099e1eaea487b7ff1ce4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_05178aeb03ce03a978c0255d089ffd76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2425396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9f492fd02559e9d816226ebffd3dda1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2535687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_e223374f4ff828ab347268ce7da6acad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479402,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_9549a418e210f6ca90fd892926c1faa8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_5ad17c0bb863fdebf7b4ada0eba50c8b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_5ff1e9b1365df036ab7cfac77e378760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_240f0c6420114214658bebc4acb098fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c38c50e-0e07-51ec-bf59-7ab99493dc8c/3c38c50e-0e07-51ec-bf59-7ab99493dc8c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/b4/94b428d3cf3bad072a68b379650362b4/pa/NZ79152_ba2d440bcd3b9ef164f6d4458c77cf1d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ79152%27 HTTP/1.1" 200 None
2026-03-28 18:39:34 [auto1.de] INFO: Saving data for NZ79152: {'created_time': 1774723174.778453, 'last_price_update_time': 1774723174.778465, 'auction_closing_time': 1774886037.0}
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ79152') HTTP/1.1" 204 0
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb218d0>
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_98acae30d6f652d2c7ba6e928caa4ead.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_98acae30d6f652d2c7ba6e928caa4ead.jpg saved to cache
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cacc695-7706-51bc-b762-2927968f0f61
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_f82ec6ee340633921d8b2ececd301a37.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_f73940b7b18e9647361f867fa98d9e0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beb2e50>
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga2%252Fe6%252Fa2e60eb6c40ee1f6910c44b84259ffc8%252Fpa%252FNS35557_cf2f775ae99af4cd104243ac8af91157.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_cf2f775ae99af4cd104243ac8af91157.jpg saved to cache
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf
2026-03-28 18:39:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf, skipping ID generation
2026-03-28 18:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with scrape type 1
2026-03-28 18:39:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 25eafa3c-1875-5bae-8ca1-33ab78e8aabf sending to next pipeline
2026-03-28 18:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf, identifier: NS35557
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b180850>
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_c4d1ea9a65caddbdc80aed9fcb7c6069.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_c4d1ea9a65caddbdc80aed9fcb7c6069.jpg saved to cache
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bfce597-aa07-525a-9379-4a3e07dff8cd
2026-03-28 18:39:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb60d10>
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_54b24147adc0e8133b03dc3217e516ea.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_54b24147adc0e8133b03dc3217e516ea.jpg saved to cache
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b11d390>
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_24d9a9b86d5eb9bbf5d814c72d23db7d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_24d9a9b86d5eb9bbf5d814c72d23db7d.jpg saved to cache
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cacc695-7706-51bc-b762-2927968f0f61
2026-03-28 18:39:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a4c6550>
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_ad32dfa87e27cf82230cdf54930150bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_ad32dfa87e27cf82230cdf54930150bd.jpg saved to cache
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf3c10>
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_7d01a6941a6af66e46018f4c69bb4ae2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_7d01a6941a6af66e46018f4c69bb4ae2.jpg saved to cache
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdded90>
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_4cfb05111b0755c0c58f1ed27a463d22.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_4cfb05111b0755c0c58f1ed27a463d22.jpg saved to cache
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cacc695-7706-51bc-b762-2927968f0f61
2026-03-28 18:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with identifier: NS35557
2026-03-28 18:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with identifier: NS35557
2026-03-28 18:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25eafa3c-1875-5bae-8ca1-33ab78e8aabf with identifier: NS35557 to the API
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_cf2f775ae99af4cd104243ac8af91157.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:14:20Z',
 'fuel_type': 'diesel',
 'id': '25eafa3c-1875-5bae-8ca1-33ab78e8aabf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS35557',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 146716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_5f231bb44afdd1d9f12535f2900cc647.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_a608fd3f1759693e101c347b203eae3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2761902,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_3b33badbed62b531ff39e7856420c6cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2758311,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_cf2f775ae99af4cd104243ac8af91157.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2999178,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_7b66e1206f7fc8fd19f1de8524f7ab2d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2967309,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_e5204145fae36a5a55b9765b42493517.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2918280,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_7b56085513fd44a658c797dd9376aef4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_29544507914cf5b98eaf78619e187c0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_1cc6b4b176c23e1a5f50ef240d4e72a4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_25eafa3c-1875-5bae-8ca1-33ab78e8aabf/25eafa3c-1875-5bae-8ca1-33ab78e8aabf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga2/e6/a2e60eb6c40ee1f6910c44b84259ffc8/pa/NS35557_889e9f30bc2cc2c80df419132fcbce2d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2018}
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS35557%27 HTTP/1.1" 200 None
2026-03-28 18:39:35 [auto1.de] INFO: Saving data for NS35557: {'created_time': 1774723175.916181, 'last_price_update_time': 1774723175.916193, 'auction_closing_time': 1774883660.0}
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS35557') HTTP/1.1" 204 0
2026-03-28 18:39:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY42721> (referer: https://www.auto1.com/v1/car-details-view/SY42721/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4befe4d0>
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_f82ec6ee340633921d8b2ececd301a37.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_f82ec6ee340633921d8b2ececd301a37.jpg saved to cache
2026-03-28 18:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bfce597-aa07-525a-9379-4a3e07dff8cd
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b183810>
2026-03-28 18:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_f73940b7b18e9647361f867fa98d9e0d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_f73940b7b18e9647361f867fa98d9e0d.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a6ae06-cf8f-544c-aedc-84723aedb596 with identifier: SY42721
2026-03-28 18:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a6ae06-cf8f-544c-aedc-84723aedb596 with scrape type 1
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_be29a62e96b4aa414a1433d338d2505e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_be29a62e96b4aa414a1433d338d2505e.jpg not downloaded yet
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_544d485806489154229ffa020f5dae62.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_544d485806489154229ffa020f5dae62.jpg not downloaded yet
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_2a82e3261041e07f9dd7b5040090bb67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_2a82e3261041e07f9dd7b5040090bb67.jpg not downloaded yet
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_c0237bee431c36ce1e7dafc0e3d63288.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_c0237bee431c36ce1e7dafc0e3d63288.jpg not downloaded yet
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_1aae0972f285e29f3302951bb73bc138.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_1aae0972f285e29f3302951bb73bc138.jpg not downloaded yet
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_44e3f145cf7c34a70077699ab9ec66b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_44e3f145cf7c34a70077699ab9ec66b5.jpg not downloaded yet
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_10de862c0da534a41a888bbe4515da47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_10de862c0da534a41a888bbe4515da47.jpg not downloaded yet
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_caa083093ec00f931daa2eecfee00717.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_a8d3d0576e28251554cd5efbcdecc22c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_a8d3d0576e28251554cd5efbcdecc22c.jpg not downloaded yet
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_181457cc94ea80bdb4fa1d51f9ee1881.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_6b0cda588566c6cc329171ed56e7fc38.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_e9f2222c6155da386d337e5e0195ae71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_e9f2222c6155da386d337e5e0195ae71.jpg not downloaded yet
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_c84f23a67e23b677dc28832484720488.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_c84f23a67e23b677dc28832484720488.jpg not downloaded yet
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_2b5503a55eea89e1a72d85883d954f55.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_521f6690f5d1ce7ab4a987142e20a3fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_b9b084051f6f091a7d27f5d1af6ba5e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_4daf45a710b3bf4a27a7c88a8b469ac0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_dc7b4b52c53b21e14872b2461eb42653.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b206310>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_caa083093ec00f931daa2eecfee00717.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_caa083093ec00f931daa2eecfee00717.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fdfd50>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_181457cc94ea80bdb4fa1d51f9ee1881.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_181457cc94ea80bdb4fa1d51f9ee1881.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59cf6d50>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_6b0cda588566c6cc329171ed56e7fc38.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_6b0cda588566c6cc329171ed56e7fc38.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_90d0f92caba88f248d503e6df017847b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_f3df7288c241c2801f719dc3c1370e4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_b6084b249782d0dc77b8259419a5bd85.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7fa10>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_2b5503a55eea89e1a72d85883d954f55.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_2b5503a55eea89e1a72d85883d954f55.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b6797af90>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_521f6690f5d1ce7ab4a987142e20a3fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_521f6690f5d1ce7ab4a987142e20a3fa.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd7790>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_b9b084051f6f091a7d27f5d1af6ba5e3.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_b9b084051f6f091a7d27f5d1af6ba5e3.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda6010>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_4daf45a710b3bf4a27a7c88a8b469ac0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_4daf45a710b3bf4a27a7c88a8b469ac0.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd6310>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_dc7b4b52c53b21e14872b2461eb42653.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_dc7b4b52c53b21e14872b2461eb42653.jpg saved to cache
2026-03-28 18:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_10de862c0da534a41a888bbe4515da47.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_f7b61460c32e98f8dcd255a270c46c65.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_44e3f145cf7c34a70077699ab9ec66b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_c84f23a67e23b677dc28832484720488.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_1aae0972f285e29f3302951bb73bc138.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbfab10>
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_90d0f92caba88f248d503e6df017847b.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_90d0f92caba88f248d503e6df017847b.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bfce597-aa07-525a-9379-4a3e07dff8cd
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe0050>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_f3df7288c241c2801f719dc3c1370e4d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_f3df7288c241c2801f719dc3c1370e4d.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7f710>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_b6084b249782d0dc77b8259419a5bd85.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_b6084b249782d0dc77b8259419a5bd85.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_be29a62e96b4aa414a1433d338d2505e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26c410>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_10de862c0da534a41a888bbe4515da47.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_10de862c0da534a41a888bbe4515da47.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b113c50>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_f7b61460c32e98f8dcd255a270c46c65.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_f7b61460c32e98f8dcd255a270c46c65.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3df50>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_44e3f145cf7c34a70077699ab9ec66b5.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_44e3f145cf7c34a70077699ab9ec66b5.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b289c50>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_c84f23a67e23b677dc28832484720488.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_c84f23a67e23b677dc28832484720488.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b113710>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_1aae0972f285e29f3302951bb73bc138.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_1aae0972f285e29f3302951bb73bc138.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_c0237bee431c36ce1e7dafc0e3d63288.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_e9f2222c6155da386d337e5e0195ae71.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_544d485806489154229ffa020f5dae62.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_2a82e3261041e07f9dd7b5040090bb67.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_a8d3d0576e28251554cd5efbcdecc22c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b070e50>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_be29a62e96b4aa414a1433d338d2505e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_be29a62e96b4aa414a1433d338d2505e.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR24120> (referer: https://www.auto1.com/v1/car-details-view/PR24120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_771755a6fcdeab5c400176ea54a74de7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_02b3fbe0cf4e0a1dacaaf60e78bbe63b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc17a90>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_c0237bee431c36ce1e7dafc0e3d63288.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_c0237bee431c36ce1e7dafc0e3d63288.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_4890c4e6875587a4aba2118a40aba337.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_6f9bf7e02a07858d0b080904e881e6fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_85a645501b780b5140df2d544d0bf34c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbce250>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_e9f2222c6155da386d337e5e0195ae71.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_e9f2222c6155da386d337e5e0195ae71.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1f9c90>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_544d485806489154229ffa020f5dae62.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_544d485806489154229ffa020f5dae62.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb60a90>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_2a82e3261041e07f9dd7b5040090bb67.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_2a82e3261041e07f9dd7b5040090bb67.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be71fd0>
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F47%252F5047d8a1bd736327e6dd2e200000f69c%252Fpa%252FSY42721_a8d3d0576e28251554cd5efbcdecc22c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_a8d3d0576e28251554cd5efbcdecc22c.jpg saved to cache
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76a6ae06-cf8f-544c-aedc-84723aedb596
2026-03-28 18:39:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76a6ae06-cf8f-544c-aedc-84723aedb596, skipping ID generation
2026-03-28 18:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a6ae06-cf8f-544c-aedc-84723aedb596 with scrape type 1
2026-03-28 18:39:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76a6ae06-cf8f-544c-aedc-84723aedb596 sending to next pipeline
2026-03-28 18:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76a6ae06-cf8f-544c-aedc-84723aedb596, identifier: SY42721
2026-03-28 18:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_d79eb2efa73a57e6f50325288d78824a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76a6ae06-cf8f-544c-aedc-84723aedb596 with identifier: SY42721
2026-03-28 18:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76a6ae06-cf8f-544c-aedc-84723aedb596 with identifier: SY42721
2026-03-28 18:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76a6ae06-cf8f-544c-aedc-84723aedb596 with identifier: SY42721 to the API
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_a8d3d0576e28251554cd5efbcdecc22c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:31:04Z',
 'fuel_type': 'petrol',
 'id': '76a6ae06-cf8f-544c-aedc-84723aedb596',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY42721',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 77017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_be29a62e96b4aa414a1433d338d2505e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82771,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_544d485806489154229ffa020f5dae62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_2a82e3261041e07f9dd7b5040090bb67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_c0237bee431c36ce1e7dafc0e3d63288.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_1aae0972f285e29f3302951bb73bc138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_44e3f145cf7c34a70077699ab9ec66b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_10de862c0da534a41a888bbe4515da47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_a8d3d0576e28251554cd5efbcdecc22c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_e9f2222c6155da386d337e5e0195ae71.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a6ae06-cf8f-544c-aedc-84723aedb596/76a6ae06-cf8f-544c-aedc-84723aedb596_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/47/5047d8a1bd736327e6dd2e200000f69c/pa/SY42721_c84f23a67e23b677dc28832484720488.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY42721%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [auto1.de] INFO: Saving data for SY42721: {'created_time': 1774723178.341707, 'last_price_update_time': 1774723178.341718, 'auction_closing_time': 1774884664.0}
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY42721') HTTP/1.1" 204 0
2026-03-28 18:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c304d9a5-2d68-5d7a-ac77-74cd66854393 with identifier: PR24120
2026-03-28 18:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c304d9a5-2d68-5d7a-ac77-74cd66854393 with scrape type 1
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_4b4e43bb9960aba6533b32b4548a986e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4b4e43bb9960aba6533b32b4548a986e.jpg not downloaded yet
2026-03-28 18:39:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bde79d0>
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_771755a6fcdeab5c400176ea54a74de7.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_771755a6fcdeab5c400176ea54a74de7.jpg saved to cache
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbfbb50>
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_02b3fbe0cf4e0a1dacaaf60e78bbe63b.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_02b3fbe0cf4e0a1dacaaf60e78bbe63b.jpg saved to cache
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_9127d34317d3801b4a167ff3d1811f6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_7272babbde4409b2842cab8c940606fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_2203ce7b39ede3c371a8225653dc946e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_433453c92275c2acc2dd45cee0798429.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_433453c92275c2acc2dd45cee0798429.jpg not downloaded yet
2026-03-28 18:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG52031> (referer: https://www.auto1.com/v1/car-details-view/WG52031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0d290>
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_4890c4e6875587a4aba2118a40aba337.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_4890c4e6875587a4aba2118a40aba337.jpg saved to cache
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bfce597-aa07-525a-9379-4a3e07dff8cd
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bddd490>
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_6f9bf7e02a07858d0b080904e881e6fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_6f9bf7e02a07858d0b080904e881e6fa.jpg saved to cache
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cacc695-7706-51bc-b762-2927968f0f61
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b06fcd0>
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_85a645501b780b5140df2d544d0bf34c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_85a645501b780b5140df2d544d0bf34c.jpg saved to cache
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b012f10>
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_d79eb2efa73a57e6f50325288d78824a.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_d79eb2efa73a57e6f50325288d78824a.jpg saved to cache
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bfce597-aa07-525a-9379-4a3e07dff8cd
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_3f91b29fd90ae1c208810b47778b509e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_3f91b29fd90ae1c208810b47778b509e.jpg not downloaded yet
2026-03-28 18:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_e4f1290f8a6fa5416e981bbea12f2351.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_4afad52366049df5104b0f7fc34bbcc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4afad52366049df5104b0f7fc34bbcc9.jpg not downloaded yet
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0c390>
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F6d%252Fb86d414db53b82c3b3e4a49a22471d3f%252Fpa%252FWA51516_9127d34317d3801b4a167ff3d1811f6f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_9127d34317d3801b4a167ff3d1811f6f.jpg saved to cache
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cacc695-7706-51bc-b762-2927968f0f61
2026-03-28 18:39:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cacc695-7706-51bc-b762-2927968f0f61, skipping ID generation
2026-03-28 18:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cacc695-7706-51bc-b762-2927968f0f61 with scrape type 1
2026-03-28 18:39:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cacc695-7706-51bc-b762-2927968f0f61 sending to next pipeline
2026-03-28 18:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cacc695-7706-51bc-b762-2927968f0f61, identifier: WA51516
2026-03-28 18:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26cb50>
2026-03-28 18:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F6e%252F5c6e007a29ba852e7d13327ea62adc88%252Fpa%252FVR29597_7272babbde4409b2842cab8c940606fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_7272babbde4409b2842cab8c940606fb.jpg saved to cache
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bfce597-aa07-525a-9379-4a3e07dff8cd
2026-03-28 18:39:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bfce597-aa07-525a-9379-4a3e07dff8cd, skipping ID generation
2026-03-28 18:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bfce597-aa07-525a-9379-4a3e07dff8cd with scrape type 1
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bfce597-aa07-525a-9379-4a3e07dff8cd sending to next pipeline
2026-03-28 18:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bfce597-aa07-525a-9379-4a3e07dff8cd, identifier: VR29597
2026-03-28 18:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbf9090>
2026-03-28 18:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_2203ce7b39ede3c371a8225653dc946e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_2203ce7b39ede3c371a8225653dc946e.jpg saved to cache
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with identifier: WG52031
2026-03-28 18:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with scrape type 1
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e775dedb-ac94-5a4a-ba6a-fefedb8fd15c
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F75%252Fe875fc3fadcebfe6a3060a970c7e4c23%252Fpa%252FWG52031_fd95e8e541f8a86f5c14e2b9027aa974.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_fd95e8e541f8a86f5c14e2b9027aa974.jpg already downloaded
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F75%252Fe875fc3fadcebfe6a3060a970c7e4c23%252Fpa%252FWG52031_78266da4d10d07427654e7a91fd1fc67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_78266da4d10d07427654e7a91fd1fc67.jpg already downloaded
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F75%252Fe875fc3fadcebfe6a3060a970c7e4c23%252Fpa%252FWG52031_ab2ef4a157926a9b63b3523d49b350e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_ab2ef4a157926a9b63b3523d49b350e0.jpg already downloaded
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F75%252Fe875fc3fadcebfe6a3060a970c7e4c23%252Fpa%252FWG52031_ab7bd67af20922c44f3cf581d81a3752.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_ab7bd67af20922c44f3cf581d81a3752.jpg already downloaded
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F75%252Fe875fc3fadcebfe6a3060a970c7e4c23%252Fpa%252FWG52031_f7f7eba8115d14d2922d3899655263ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_f7f7eba8115d14d2922d3899655263ed.jpg already downloaded
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F75%252Fe875fc3fadcebfe6a3060a970c7e4c23%252Fpa%252FWG52031_74eb5445960e6524202c6ede1d5c448c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_74eb5445960e6524202c6ede1d5c448c.jpg already downloaded
2026-03-28 18:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c, identifier: WG52031
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_e88a65b7b03728be0e841beb88b2ebae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_e88a65b7b03728be0e841beb88b2ebae.jpg not downloaded yet
2026-03-28 18:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cacc695-7706-51bc-b762-2927968f0f61 with identifier: WA51516
2026-03-28 18:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cacc695-7706-51bc-b762-2927968f0f61 with identifier: WA51516
2026-03-28 18:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cacc695-7706-51bc-b762-2927968f0f61 with identifier: WA51516 to the API
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_9127d34317d3801b4a167ff3d1811f6f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:27:05Z',
 'fuel_type': 'petrol',
 'id': '5cacc695-7706-51bc-b762-2927968f0f61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA51516',
 'listing': 'auction',
 'location': 'DE, Paderborn',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 182361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 136382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_6f9bf7e02a07858d0b080904e881e6fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_98acae30d6f652d2c7ba6e928caa4ead.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101282,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_9127d34317d3801b4a167ff3d1811f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78785,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_24d9a9b86d5eb9bbf5d814c72d23db7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cacc695-7706-51bc-b762-2927968f0f61/5cacc695-7706-51bc-b762-2927968f0f61_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/6d/b86d414db53b82c3b3e4a49a22471d3f/pa/WA51516_4cfb05111b0755c0c58f1ed27a463d22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volvo C30 2.5 T5 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA51516%27 HTTP/1.1" 200 None
2026-03-28 18:39:39 [auto1.de] INFO: Saving data for WA51516: {'created_time': 1774723179.818507, 'last_price_update_time': 1774723179.818519, 'auction_closing_time': 1774884425.0}
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA51516') HTTP/1.1" 204 0
2026-03-28 18:39:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bfce597-aa07-525a-9379-4a3e07dff8cd with identifier: VR29597
2026-03-28 18:39:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bfce597-aa07-525a-9379-4a3e07dff8cd with identifier: VR29597
2026-03-28 18:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bfce597-aa07-525a-9379-4a3e07dff8cd with identifier: VR29597 to the API
2026-03-28 18:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_7272babbde4409b2842cab8c940606fb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'petrol',
 'id': '2bfce597-aa07-525a-9379-4a3e07dff8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR29597',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 49968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_d79eb2efa73a57e6f50325288d78824a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_4890c4e6875587a4aba2118a40aba337.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_7272babbde4409b2842cab8c940606fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_c4d1ea9a65caddbdc80aed9fcb7c6069.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_90d0f92caba88f248d503e6df017847b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2bfce597-aa07-525a-9379-4a3e07dff8cd/2bfce597-aa07-525a-9379-4a3e07dff8cd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/6e/5c6e007a29ba852e7d13327ea62adc88/pa/VR29597_f82ec6ee340633921d8b2ececd301a37.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-21',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2013}
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR29597%27 HTTP/1.1" 200 None
2026-03-28 18:39:40 [auto1.de] INFO: Saving data for VR29597: {'created_time': 1774723180.19054, 'last_price_update_time': 1774723180.190551, 'auction_closing_time': 1774884330.0}
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR29597') HTTP/1.1" 204 0
2026-03-28 18:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with identifier: WG52031
2026-03-28 18:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with identifier: WG52031
2026-03-28 18:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e775dedb-ac94-5a4a-ba6a-fefedb8fd15c with identifier: WG52031 to the API
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WG52031>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:22:33Z',
 'fuel_type': 'petrol',
 'id': 'e775dedb-ac94-5a4a-ba6a-fefedb8fd15c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG52031',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 207752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_fd95e8e541f8a86f5c14e2b9027aa974.jpg',
                'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_78266da4d10d07427654e7a91fd1fc67.jpg',
                'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_ab2ef4a157926a9b63b3523d49b350e0.jpg',
                'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_ab7bd67af20922c44f3cf581d81a3752.jpg',
                'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_f7f7eba8115d14d2922d3899655263ed.jpg',
                'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_74eb5445960e6524202c6ede1d5c448c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e775dedb-ac94-5a4a-ba6a-fefedb8fd15c/e775dedb-ac94-5a4a-ba6a-fefedb8fd15c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_fd95e8e541f8a86f5c14e2b9027aa974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e775dedb-ac94-5a4a-ba6a-fefedb8fd15c/e775dedb-ac94-5a4a-ba6a-fefedb8fd15c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_78266da4d10d07427654e7a91fd1fc67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e775dedb-ac94-5a4a-ba6a-fefedb8fd15c/e775dedb-ac94-5a4a-ba6a-fefedb8fd15c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_ab2ef4a157926a9b63b3523d49b350e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e775dedb-ac94-5a4a-ba6a-fefedb8fd15c/e775dedb-ac94-5a4a-ba6a-fefedb8fd15c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_ab7bd67af20922c44f3cf581d81a3752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e775dedb-ac94-5a4a-ba6a-fefedb8fd15c/e775dedb-ac94-5a4a-ba6a-fefedb8fd15c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_f7f7eba8115d14d2922d3899655263ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e775dedb-ac94-5a4a-ba6a-fefedb8fd15c/e775dedb-ac94-5a4a-ba6a-fefedb8fd15c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/75/e875fc3fadcebfe6a3060a970c7e4c23/pa/WG52031_74eb5445960e6524202c6ede1d5c448c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG52031%27 HTTP/1.1" 200 None
2026-03-28 18:39:40 [auto1.de] INFO: Saving data for WG52031: {'created_time': 1774723180.527355, 'last_price_update_time': 1774723180.527367, 'auction_closing_time': 1774884153.0}
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG52031') HTTP/1.1" 204 0
2026-03-28 18:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4b4e43bb9960aba6533b32b4548a986e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_35cdc96eb37d9f52493a0396b1e3174d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_19c236b4ca41b8113f60308f898fe3d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_5c9c1f35efecc37c41a75cdf05954773.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_5c9c1f35efecc37c41a75cdf05954773.jpg not downloaded yet
2026-03-28 18:39:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT21216/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_4c9436cbcca4748c107cc2f6421d377c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4c9436cbcca4748c107cc2f6421d377c.jpg not downloaded yet
2026-03-28 18:39:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0bb10>
2026-03-28 18:39:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F31%252Fb33113bc568082f97345f4c6a0edfc2e%252Fpa%252FDZ20117_e4f1290f8a6fa5416e981bbea12f2351.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_e4f1290f8a6fa5416e981bbea12f2351.jpg saved to cache
2026-03-28 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7
2026-03-28 18:39:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7, skipping ID generation
2026-03-28 18:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with scrape type 1
2026-03-28 18:39:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 sending to next pipeline
2026-03-28 18:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7, identifier: DZ20117
2026-03-28 18:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with identifier: DZ20117
2026-03-28 18:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with identifier: DZ20117
2026-03-28 18:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5cbd75d-099e-5368-8b3e-6c08a3ce15e7 with identifier: DZ20117 to the API
2026-03-28 18:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_e4f1290f8a6fa5416e981bbea12f2351.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:56:53Z',
 'fuel_type': 'petrol',
 'id': 'c5cbd75d-099e-5368-8b3e-6c08a3ce15e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ20117',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 96552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756383,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_ad32dfa87e27cf82230cdf54930150bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640953,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_e4f1290f8a6fa5416e981bbea12f2351.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2693551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_771755a6fcdeab5c400176ea54a74de7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_f3df7288c241c2801f719dc3c1370e4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640455,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_2b5503a55eea89e1a72d85883d954f55.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_181457cc94ea80bdb4fa1d51f9ee1881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_caa083093ec00f931daa2eecfee00717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2740271,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_4daf45a710b3bf4a27a7c88a8b469ac0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2726063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_b9b084051f6f091a7d27f5d1af6ba5e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c5cbd75d-099e-5368-8b3e-6c08a3ce15e7/c5cbd75d-099e-5368-8b3e-6c08a3ce15e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/31/b33113bc568082f97345f4c6a0edfc2e/pa/DZ20117_6b0cda588566c6cc329171ed56e7fc38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-09-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2020}
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ20117%27 HTTP/1.1" 200 None
2026-03-28 18:39:41 [auto1.de] INFO: Saving data for DZ20117: {'created_time': 1774723181.23303, 'last_price_update_time': 1774723181.233041, 'auction_closing_time': 1774886213.0}
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ20117') HTTP/1.1" 204 0
2026-03-28 18:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_a37b33842b1705dca3c449fb1d1b80b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_895399a2ae3b3f9d69b77c7f8b0da15d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_895399a2ae3b3f9d69b77c7f8b0da15d.jpg not downloaded yet
2026-03-28 18:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_37a6dd2a31920e15e2ccec3be3a60f31.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_9a901388445663d8fa9c99ea01ca105c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_cdf95cdfc9fe07b0a357246ea13fe67f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_cdf95cdfc9fe07b0a357246ea13fe67f.jpg not downloaded yet
2026-03-28 18:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0ad50>
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_4b4e43bb9960aba6533b32b4548a986e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4b4e43bb9960aba6533b32b4548a986e.jpg saved to cache
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b000dd0>
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_35cdc96eb37d9f52493a0396b1e3174d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_35cdc96eb37d9f52493a0396b1e3174d.jpg saved to cache
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb37b50>
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_19c236b4ca41b8113f60308f898fe3d2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_19c236b4ca41b8113f60308f898fe3d2.jpg saved to cache
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_07e1adcf4b08b201a357039865ff2dcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_07e1adcf4b08b201a357039865ff2dcc.jpg not downloaded yet
2026-03-28 18:39:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_e88a65b7b03728be0e841beb88b2ebae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb1610>
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_a37b33842b1705dca3c449fb1d1b80b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_a37b33842b1705dca3c449fb1d1b80b2.jpg saved to cache
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb2c90>
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F8e%252Ff38eb700747e0fc4de14cf21cc1becd8%252Fpa%252FMX21840_37a6dd2a31920e15e2ccec3be3a60f31.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_37a6dd2a31920e15e2ccec3be3a60f31.jpg saved to cache
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b3a25024-0e37-5a46-9b5b-91027aade4ba
2026-03-28 18:39:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b3a25024-0e37-5a46-9b5b-91027aade4ba, skipping ID generation
2026-03-28 18:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3a25024-0e37-5a46-9b5b-91027aade4ba with scrape type 1
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b3a25024-0e37-5a46-9b5b-91027aade4ba sending to next pipeline
2026-03-28 18:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3a25024-0e37-5a46-9b5b-91027aade4ba, identifier: MX21840
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbeb810>
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Ffe%252Fc8fe00de342a75f9f23856e244f1b110%252Fpa%252FHH84481_9a901388445663d8fa9c99ea01ca105c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_9a901388445663d8fa9c99ea01ca105c.jpg saved to cache
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 918d6851-986f-5c47-9508-5d77ea02efee
2026-03-28 18:39:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 918d6851-986f-5c47-9508-5d77ea02efee, skipping ID generation
2026-03-28 18:39:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 918d6851-986f-5c47-9508-5d77ea02efee with scrape type 1
2026-03-28 18:39:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 918d6851-986f-5c47-9508-5d77ea02efee sending to next pipeline
2026-03-28 18:39:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 918d6851-986f-5c47-9508-5d77ea02efee, identifier: HH84481
2026-03-28 18:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3a25024-0e37-5a46-9b5b-91027aade4ba with identifier: MX21840
2026-03-28 18:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3a25024-0e37-5a46-9b5b-91027aade4ba with identifier: MX21840
2026-03-28 18:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3a25024-0e37-5a46-9b5b-91027aade4ba with identifier: MX21840 to the API
2026-03-28 18:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_37a6dd2a31920e15e2ccec3be3a60f31.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:34:45Z',
 'fuel_type': 'petrol',
 'id': 'b3a25024-0e37-5a46-9b5b-91027aade4ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX21840',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 114518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_37a6dd2a31920e15e2ccec3be3a60f31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_19c236b4ca41b8113f60308f898fe3d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3261566,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_7d01a6941a6af66e46018f4c69bb4ae2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_f342ca6e6dbd0b90c485eb04556ff932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_beac3eda8fdcf74629c4a44c5a13a682.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3089637,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_35f37f987890f6ecc204de39a2107c3d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_90ec2b140a77c4ae5dfc05524f5724b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_1f1a181f140fa65f1bc1127b9e7e13da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1186256,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_df046884922ec83e12f3fa581a7d0e0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b3a25024-0e37-5a46-9b5b-91027aade4ba/b3a25024-0e37-5a46-9b5b-91027aade4ba_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/8e/f38eb700747e0fc4de14cf21cc1becd8/pa/MX21840_579dad020708aab297f8c8e7ee989ccb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI StylePlus',
 'transmission': 'manual',
 'trim': 'StylePlus',
 'year': 2014}
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX21840%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [auto1.de] INFO: Saving data for MX21840: {'created_time': 1774723182.116302, 'last_price_update_time': 1774723182.116313, 'auction_closing_time': 1774884885.0}
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX21840') HTTP/1.1" 204 0
2026-03-28 18:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 918d6851-986f-5c47-9508-5d77ea02efee with identifier: HH84481
2026-03-28 18:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 918d6851-986f-5c47-9508-5d77ea02efee with identifier: HH84481
2026-03-28 18:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 918d6851-986f-5c47-9508-5d77ea02efee with identifier: HH84481 to the API
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_9a901388445663d8fa9c99ea01ca105c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:08:35Z',
 'fuel_type': 'hybrid',
 'id': '918d6851-986f-5c47-9508-5d77ea02efee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH84481',
 'listing': 'auction',
 'location': 'DE, Dormagen',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 53438,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878963,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_5832a7b282860fea05c824772458a2b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2922741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_0739a639e18216c82634fe0cd3bf6c58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81809,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_4e7168a18fdd77738534a58da4ba54be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_87f95c4df944b18a8f6cd47c6fb323de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2868996,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_d15f46c47dcda0cce85b796fbf456057.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_9a901388445663d8fa9c99ea01ca105c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_a37b33842b1705dca3c449fb1d1b80b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_35cdc96eb37d9f52493a0396b1e3174d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_2203ce7b39ede3c371a8225653dc946e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_918d6851-986f-5c47-9508-5d77ea02efee/918d6851-986f-5c47-9508-5d77ea02efee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/fe/c8fe00de342a75f9f23856e244f1b110/pa/HH84481_95293dc7fe59384e1252961c6d470691.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 xDrive 25e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH84481%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [auto1.de] INFO: Saving data for HH84481: {'created_time': 1774723182.485562, 'last_price_update_time': 1774723182.485573, 'auction_closing_time': 1774883315.0}
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH84481') HTTP/1.1" 204 0
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_3f91b29fd90ae1c208810b47778b509e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4afad52366049df5104b0f7fc34bbcc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG66001> (referer: https://www.auto1.com/v1/car-details-view/NG66001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LW95470/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf6f90>
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_e88a65b7b03728be0e841beb88b2ebae.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_e88a65b7b03728be0e841beb88b2ebae.jpg saved to cache
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_5c9c1f35efecc37c41a75cdf05954773.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_ba1df923e0afcbdf6bca8286ed463e42.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8475d97cf281f91c2bde975e579a5f81.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_300a3e2e7b126c5394e439b099b7f4b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8da8100b6b098d343aa90d76c420f702.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_433453c92275c2acc2dd45cee0798429.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcc550>
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_3f91b29fd90ae1c208810b47778b509e.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_3f91b29fd90ae1c208810b47778b509e.jpg saved to cache
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb60450>
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_4afad52366049df5104b0f7fc34bbcc9.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4afad52366049df5104b0f7fc34bbcc9.jpg saved to cache
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_07e1adcf4b08b201a357039865ff2dcc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_895399a2ae3b3f9d69b77c7f8b0da15d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22a47020-25f8-5550-9736-fd11cd8796bf with identifier: NG66001
2026-03-28 18:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22a47020-25f8-5550-9736-fd11cd8796bf with scrape type 1
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_b94a97b5d13e53c329103c530ef13527.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_b94a97b5d13e53c329103c530ef13527.jpg not downloaded yet
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b29b010>
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_5c9c1f35efecc37c41a75cdf05954773.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_5c9c1f35efecc37c41a75cdf05954773.jpg saved to cache
2026-03-28 18:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1d1910>
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_ba1df923e0afcbdf6bca8286ed463e42.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_ba1df923e0afcbdf6bca8286ed463e42.jpg saved to cache
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd55090>
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_8475d97cf281f91c2bde975e579a5f81.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8475d97cf281f91c2bde975e579a5f81.jpg saved to cache
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b041310>
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252F99%252Fe199c41cf05542d2bc1013db504813fe%252Fpa%252FRW68722_300a3e2e7b126c5394e439b099b7f4b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_300a3e2e7b126c5394e439b099b7f4b0.jpg saved to cache
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b280a314-9b68-5026-a5dd-2cb64bbac5c5
2026-03-28 18:39:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b280a314-9b68-5026-a5dd-2cb64bbac5c5, skipping ID generation
2026-03-28 18:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b280a314-9b68-5026-a5dd-2cb64bbac5c5 with scrape type 1
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b280a314-9b68-5026-a5dd-2cb64bbac5c5 sending to next pipeline
2026-03-28 18:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b280a314-9b68-5026-a5dd-2cb64bbac5c5, identifier: RW68722
2026-03-28 18:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb9f450>
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252Fb8%252Fbbb8d3a5671e31fc0c697cfba8272ebe%252Fpa%252FYA36470_8da8100b6b098d343aa90d76c420f702.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8da8100b6b098d343aa90d76c420f702.jpg saved to cache
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64
2026-03-28 18:39:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a64e03ec-259b-5e4c-a17f-ec74d14ffb64, skipping ID generation
2026-03-28 18:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with scrape type 1
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a64e03ec-259b-5e4c-a17f-ec74d14ffb64 sending to next pipeline
2026-03-28 18:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a64e03ec-259b-5e4c-a17f-ec74d14ffb64, identifier: YA36470
2026-03-28 18:39:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf6e10>
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_433453c92275c2acc2dd45cee0798429.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_433453c92275c2acc2dd45cee0798429.jpg saved to cache
2026-03-28 18:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b280a314-9b68-5026-a5dd-2cb64bbac5c5 with identifier: RW68722
2026-03-28 18:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b280a314-9b68-5026-a5dd-2cb64bbac5c5 with identifier: RW68722
2026-03-28 18:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b280a314-9b68-5026-a5dd-2cb64bbac5c5 with identifier: RW68722 to the API
2026-03-28 18:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_300a3e2e7b126c5394e439b099b7f4b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:53:34Z',
 'fuel_type': 'petrol',
 'id': 'b280a314-9b68-5026-a5dd-2cb64bbac5c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW68722',
 'listing': 'auction',
 'location': 'DE, Schweinfurt',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 144910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2248174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_300a3e2e7b126c5394e439b099b7f4b0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_50901670a1fc0dfce2d9cf01c40ade57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_d4622dad178759c71a63a2fefccb0e0e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578586,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_5e6d3c953194d50b9139c131ec2dec42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_8009120486e60996b5e53fac457b0c9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_7b47d3597258d1ca0d5ea2793b67fb3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_9931fcadd037feee480c14be129fedb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_7a479dab0daf04d51c52a8dc5d5d6c9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2356387,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_54b24147adc0e8133b03dc3217e516ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b280a314-9b68-5026-a5dd-2cb64bbac5c5/b280a314-9b68-5026-a5dd-2cb64bbac5c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/99/e199c41cf05542d2bc1013db504813fe/pa/RW68722_4da4908d78a809de8234919da94c2e7c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2013}
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW68722%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Saving data for RW68722: {'created_time': 1774723184.177124, 'last_price_update_time': 1774723184.177137, 'auction_closing_time': 1774886014.0}
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW68722') HTTP/1.1" 204 0
2026-03-28 18:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with identifier: YA36470
2026-03-28 18:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with identifier: YA36470
2026-03-28 18:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a64e03ec-259b-5e4c-a17f-ec74d14ffb64 with identifier: YA36470 to the API
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8da8100b6b098d343aa90d76c420f702.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:59:16Z',
 'fuel_type': 'petrol',
 'id': 'a64e03ec-259b-5e4c-a17f-ec74d14ffb64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA36470',
 'listing': 'auction',
 'location': 'DE, Mannheim',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 159869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2885391,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8da8100b6b098d343aa90d76c420f702.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_8475d97cf281f91c2bde975e579a5f81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2788357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_ba1df923e0afcbdf6bca8286ed463e42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_85a645501b780b5140df2d544d0bf34c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3006713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_02b3fbe0cf4e0a1dacaaf60e78bbe63b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79168,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_f7b61460c32e98f8dcd255a270c46c65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_b6084b249782d0dc77b8259419a5bd85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_f73940b7b18e9647361f867fa98d9e0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824454,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_521f6690f5d1ce7ab4a987142e20a3fa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a64e03ec-259b-5e4c-a17f-ec74d14ffb64/a64e03ec-259b-5e4c-a17f-ec74d14ffb64_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2749094,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/b8/bbb8d3a5671e31fc0c697cfba8272ebe/pa/YA36470_dc7b4b52c53b21e14872b2461eb42653.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2013}
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA36470%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [auto1.de] INFO: Saving data for YA36470: {'created_time': 1774723184.573017, 'last_price_update_time': 1774723184.573029, 'auction_closing_time': 1774886356.0}
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA36470') HTTP/1.1" 204 0
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_d78d0d9b8bf8c3b3eb42d3848e6f1db7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_d78d0d9b8bf8c3b3eb42d3848e6f1db7.jpg not downloaded yet
2026-03-28 18:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4c9436cbcca4748c107cc2f6421d377c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU21003> (referer: https://www.auto1.com/v1/car-details-view/BU21003/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT21216> (referer: https://www.auto1.com/v1/car-details-view/YT21216/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZY92659> (referer: https://www.auto1.com/v1/car-details-view/ZY92659/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_b4b05318e62b02f7c0bb21afeff6afc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_b4b05318e62b02f7c0bb21afeff6afc1.jpg not downloaded yet
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10c910>
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_07e1adcf4b08b201a357039865ff2dcc.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_07e1adcf4b08b201a357039865ff2dcc.jpg saved to cache
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda7610>
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_895399a2ae3b3f9d69b77c7f8b0da15d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_895399a2ae3b3f9d69b77c7f8b0da15d.jpg saved to cache
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_411e2d0abc8c96e184e7c61f913eba3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_411e2d0abc8c96e184e7c61f913eba3c.jpg not downloaded yet
2026-03-28 18:39:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_aea8b0059682a0a5e03394cf25f9715d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_aea8b0059682a0a5e03394cf25f9715d.jpg not downloaded yet
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fd0110>
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_4c9436cbcca4748c107cc2f6421d377c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4c9436cbcca4748c107cc2f6421d377c.jpg saved to cache
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc33c191-2f76-589c-a08b-0648b040af26 with identifier: BU21003
2026-03-28 18:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc33c191-2f76-589c-a08b-0648b040af26 with scrape type 1
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc33c191-2f76-589c-a08b-0648b040af26
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_167ddeb45267908b1d8addd84a9c7716.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_167ddeb45267908b1d8addd84a9c7716.jpg already downloaded
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_21c025141b02eb1135a22989eb90b05a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_21c025141b02eb1135a22989eb90b05a.jpg already downloaded
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_62693add8a1209f7b397d45145278f76.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_62693add8a1209f7b397d45145278f76.jpg already downloaded
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_4d5080a6c6ec8cb2a137bb4432f5c1e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_4d5080a6c6ec8cb2a137bb4432f5c1e5.jpg already downloaded
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_fddf5ad23738d3fbf3ae62b151d6c6be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_fddf5ad23738d3fbf3ae62b151d6c6be.jpg already downloaded
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_297935bdd9514f2307d9ef870bafd37b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_297935bdd9514f2307d9ef870bafd37b.jpg already downloaded
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_2fa07dead8fa586efba09df22e73c2a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_2fa07dead8fa586efba09df22e73c2a1.jpg already downloaded
2026-03-28 18:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_7ed17c76c01f0b89577b5a3b9fe9bab9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_7ed17c76c01f0b89577b5a3b9fe9bab9.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_dd78b31223839f86d80a440b95a1686f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_dd78b31223839f86d80a440b95a1686f.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252Fd0%252Fa6d05e1973d25bce2a18116968061ce4%252Fpa%252FBU21003_2e2a606ca6992652614d94b1a6a1eaff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_2e2a606ca6992652614d94b1a6a1eaff.jpg already downloaded
2026-03-28 18:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc33c191-2f76-589c-a08b-0648b040af26, identifier: BU21003
2026-03-28 18:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e385d2c-486e-5d88-9f27-ac483a1da53b with identifier: YT21216
2026-03-28 18:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e385d2c-486e-5d88-9f27-ac483a1da53b with scrape type 1
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_32e9899dc5e311d0ec8f88e9a938615c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_32e9899dc5e311d0ec8f88e9a938615c.jpg not downloaded yet
2026-03-28 18:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ec7afe0-4458-535c-b90f-321895b6e57c with identifier: ZY92659
2026-03-28 18:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ec7afe0-4458-535c-b90f-321895b6e57c with scrape type 1
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ec7afe0-4458-535c-b90f-321895b6e57c
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_9305b5c1eaacead048d2c9f2ba1409d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_9305b5c1eaacead048d2c9f2ba1409d7.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_c189ea8d4cb61a431e59fd0380a69bc2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_c189ea8d4cb61a431e59fd0380a69bc2.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_0762080c3d9261b7efad009f28b31dc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_0762080c3d9261b7efad009f28b31dc0.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_d419d953504f4c2d8e1237f89fd1aacb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_d419d953504f4c2d8e1237f89fd1aacb.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_d09c7f4b3e81ef82607f7443074e97e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_d09c7f4b3e81ef82607f7443074e97e6.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_00f7ecad2b8013cfa400c94f10459cd4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_00f7ecad2b8013cfa400c94f10459cd4.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_00f9147ac1f858c2168ae70c267b45cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_00f9147ac1f858c2168ae70c267b45cf.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_491c1c765b6fee16f48d0a40f7e94e8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_491c1c765b6fee16f48d0a40f7e94e8c.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_e7930de375203c8f962a827acd07d3c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_e7930de375203c8f962a827acd07d3c2.jpg already downloaded
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg30%252Fde%252F30de3d4e7400eb7a55aa24ef36060616%252Fpa%252FZY92659_389242588ee41d5ab0386e2656f670f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_389242588ee41d5ab0386e2656f670f9.jpg already downloaded
2026-03-28 18:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ec7afe0-4458-535c-b90f-321895b6e57c, identifier: ZY92659
2026-03-28 18:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc33c191-2f76-589c-a08b-0648b040af26 with identifier: BU21003
2026-03-28 18:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc33c191-2f76-589c-a08b-0648b040af26 with identifier: BU21003
2026-03-28 18:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc33c191-2f76-589c-a08b-0648b040af26 with identifier: BU21003 to the API
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU21003>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:39:18Z',
 'fuel_type': 'petrol',
 'id': 'bc33c191-2f76-589c-a08b-0648b040af26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU21003',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 113677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_167ddeb45267908b1d8addd84a9c7716.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_21c025141b02eb1135a22989eb90b05a.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_62693add8a1209f7b397d45145278f76.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_4d5080a6c6ec8cb2a137bb4432f5c1e5.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_fddf5ad23738d3fbf3ae62b151d6c6be.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_297935bdd9514f2307d9ef870bafd37b.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_2fa07dead8fa586efba09df22e73c2a1.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_7ed17c76c01f0b89577b5a3b9fe9bab9.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_dd78b31223839f86d80a440b95a1686f.jpg',
                'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_2e2a606ca6992652614d94b1a6a1eaff.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_167ddeb45267908b1d8addd84a9c7716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_21c025141b02eb1135a22989eb90b05a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_62693add8a1209f7b397d45145278f76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_4d5080a6c6ec8cb2a137bb4432f5c1e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_fddf5ad23738d3fbf3ae62b151d6c6be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_297935bdd9514f2307d9ef870bafd37b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_2fa07dead8fa586efba09df22e73c2a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_7ed17c76c01f0b89577b5a3b9fe9bab9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_dd78b31223839f86d80a440b95a1686f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bc33c191-2f76-589c-a08b-0648b040af26/bc33c191-2f76-589c-a08b-0648b040af26_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/d0/a6d05e1973d25bce2a18116968061ce4/pa/BU21003_2e2a606ca6992652614d94b1a6a1eaff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i20 1.2 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2015}
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU21003%27 HTTP/1.1" 200 None
2026-03-28 18:39:45 [auto1.de] INFO: Saving data for BU21003: {'created_time': 1774723185.722586, 'last_price_update_time': 1774723185.722596, 'auction_closing_time': 1774885158.0}
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BU21003') HTTP/1.1" 204 0
2026-03-28 18:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ec7afe0-4458-535c-b90f-321895b6e57c with identifier: ZY92659
2026-03-28 18:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ec7afe0-4458-535c-b90f-321895b6e57c with identifier: ZY92659
2026-03-28 18:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ec7afe0-4458-535c-b90f-321895b6e57c with identifier: ZY92659 to the API
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZY92659>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:11:32Z',
 'fuel_type': 'petrol',
 'id': '4ec7afe0-4458-535c-b90f-321895b6e57c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY92659',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Alfa Romeo',
 'model': 'Giulietta',
 'odometer': 94031,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_9305b5c1eaacead048d2c9f2ba1409d7.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_c189ea8d4cb61a431e59fd0380a69bc2.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_0762080c3d9261b7efad009f28b31dc0.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_d419d953504f4c2d8e1237f89fd1aacb.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_d09c7f4b3e81ef82607f7443074e97e6.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_00f7ecad2b8013cfa400c94f10459cd4.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_00f9147ac1f858c2168ae70c267b45cf.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_491c1c765b6fee16f48d0a40f7e94e8c.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_e7930de375203c8f962a827acd07d3c2.jpg',
                'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_389242588ee41d5ab0386e2656f670f9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2100297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_9305b5c1eaacead048d2c9f2ba1409d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_c189ea8d4cb61a431e59fd0380a69bc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_0762080c3d9261b7efad009f28b31dc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_d419d953504f4c2d8e1237f89fd1aacb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_d09c7f4b3e81ef82607f7443074e97e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_00f7ecad2b8013cfa400c94f10459cd4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1905745,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_00f9147ac1f858c2168ae70c267b45cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_491c1c765b6fee16f48d0a40f7e94e8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_e7930de375203c8f962a827acd07d3c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ec7afe0-4458-535c-b90f-321895b6e57c/4ec7afe0-4458-535c-b90f-321895b6e57c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2445317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img30/de/30de3d4e7400eb7a55aa24ef36060616/pa/ZY92659_389242588ee41d5ab0386e2656f670f9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo Giulietta 1.4 Turbo Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2012}
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY92659%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [auto1.de] INFO: Saving data for ZY92659: {'created_time': 1774723186.074097, 'last_price_update_time': 1774723186.074114, 'auction_closing_time': 1774883492.0}
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY92659') HTTP/1.1" 204 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_d2b31c4862d648fc38663737c809e266.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_d2b31c4862d648fc38663737c809e266.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_7b1878f351e6f9f135d7d4613073b9ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_7b1878f351e6f9f135d7d4613073b9ad.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_1f03ae56cf65ccaa9363869f120fe6e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_1f03ae56cf65ccaa9363869f120fe6e4.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_9544c2f1b567f9fabc69eec3825f1c52.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_9544c2f1b567f9fabc69eec3825f1c52.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_ee4981c8fe7468ee304ec1400ffd7dee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_ee4981c8fe7468ee304ec1400ffd7dee.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_c9410c154a0dc4203437610dd5f5c334.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_c9410c154a0dc4203437610dd5f5c334.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_85903e1711699749ad7068d4fda967b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_85903e1711699749ad7068d4fda967b2.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_b5e8950c4932ec17ba22eaf3a0980aa5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b5e8950c4932ec17ba22eaf3a0980aa5.jpg not downloaded yet
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_aea8b0059682a0a5e03394cf25f9715d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_6e586d23422319deb5ef71b175b22b53.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_6e586d23422319deb5ef71b175b22b53.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_da92dd95ed555d22e45baa6c4d18f84c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_da92dd95ed555d22e45baa6c4d18f84c.jpg not downloaded yet
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_32e9899dc5e311d0ec8f88e9a938615c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_b7ace548dd112824ecbd1877d7674794.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b7ace548dd112824ecbd1877d7674794.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_e380a86e0d9fbbf3e2ddd654fd1f4de1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_e380a86e0d9fbbf3e2ddd654fd1f4de1.jpg not downloaded yet
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_98cb31eaea0d49a983c55965d0563174.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_98cb31eaea0d49a983c55965d0563174.jpg not downloaded yet
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_d2b31c4862d648fc38663737c809e266.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_ff90d9d11023f14814310e3b1d640b07.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_ff90d9d11023f14814310e3b1d640b07.jpg not downloaded yet
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb94590>
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_aea8b0059682a0a5e03394cf25f9715d.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_aea8b0059682a0a5e03394cf25f9715d.jpg saved to cache
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_7b1878f351e6f9f135d7d4613073b9ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_1f03ae56cf65ccaa9363869f120fe6e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_cdf95cdfc9fe07b0a357246ea13fe67f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b025750>
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_32e9899dc5e311d0ec8f88e9a938615c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_32e9899dc5e311d0ec8f88e9a938615c.jpg saved to cache
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_9544c2f1b567f9fabc69eec3825f1c52.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_ee4981c8fe7468ee304ec1400ffd7dee.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd5b2d0>
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_d2b31c4862d648fc38663737c809e266.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_d2b31c4862d648fc38663737c809e266.jpg saved to cache
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_85903e1711699749ad7068d4fda967b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_b4b05318e62b02f7c0bb21afeff6afc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_d78d0d9b8bf8c3b3eb42d3848e6f1db7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_b94a97b5d13e53c329103c530ef13527.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbf9910>
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_7b1878f351e6f9f135d7d4613073b9ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_7b1878f351e6f9f135d7d4613073b9ad.jpg saved to cache
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b253f10>
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_1f03ae56cf65ccaa9363869f120fe6e4.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_1f03ae56cf65ccaa9363869f120fe6e4.jpg saved to cache
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_411e2d0abc8c96e184e7c61f913eba3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_c9410c154a0dc4203437610dd5f5c334.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbfbd50>
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fc4%252Fdfc4ca9e40057e9898a90ec377075d50%252Fpa%252FPR24120_cdf95cdfc9fe07b0a357246ea13fe67f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_cdf95cdfc9fe07b0a357246ea13fe67f.jpg saved to cache
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c304d9a5-2d68-5d7a-ac77-74cd66854393
2026-03-28 18:39:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c304d9a5-2d68-5d7a-ac77-74cd66854393, skipping ID generation
2026-03-28 18:39:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c304d9a5-2d68-5d7a-ac77-74cd66854393 with scrape type 1
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c304d9a5-2d68-5d7a-ac77-74cd66854393 sending to next pipeline
2026-03-28 18:39:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c304d9a5-2d68-5d7a-ac77-74cd66854393, identifier: PR24120
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc1c190>
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_9544c2f1b567f9fabc69eec3825f1c52.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_9544c2f1b567f9fabc69eec3825f1c52.jpg saved to cache
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b026b50>
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_ee4981c8fe7468ee304ec1400ffd7dee.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_ee4981c8fe7468ee304ec1400ffd7dee.jpg saved to cache
2026-03-28 18:39:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c304d9a5-2d68-5d7a-ac77-74cd66854393 with identifier: PR24120
2026-03-28 18:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c304d9a5-2d68-5d7a-ac77-74cd66854393 with identifier: PR24120
2026-03-28 18:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c304d9a5-2d68-5d7a-ac77-74cd66854393 with identifier: PR24120 to the API
2026-03-28 18:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_cdf95cdfc9fe07b0a357246ea13fe67f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:41Z',
 'fuel_type': 'diesel',
 'id': 'c304d9a5-2d68-5d7a-ac77-74cd66854393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR24120',
 'listing': 'auction',
 'location': 'DE, Deggendorf',
 'make': 'BMW',
 'model': '3er',
 'odometer': 189766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4b4e43bb9960aba6533b32b4548a986e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2528922,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_433453c92275c2acc2dd45cee0798429.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_3f91b29fd90ae1c208810b47778b509e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70055,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4afad52366049df5104b0f7fc34bbcc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_e88a65b7b03728be0e841beb88b2ebae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_5c9c1f35efecc37c41a75cdf05954773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_4c9436cbcca4748c107cc2f6421d377c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_895399a2ae3b3f9d69b77c7f8b0da15d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2195511,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_cdf95cdfc9fe07b0a357246ea13fe67f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c304d9a5-2d68-5d7a-ac77-74cd66854393/c304d9a5-2d68-5d7a-ac77-74cd66854393_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/c4/dfc4ca9e40057e9898a90ec377075d50/pa/PR24120_07e1adcf4b08b201a357039865ff2dcc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR24120%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [auto1.de] INFO: Saving data for PR24120: {'created_time': 1774723187.27897, 'last_price_update_time': 1774723187.278982, 'auction_closing_time': 1774883621.0}
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR24120') HTTP/1.1" 204 0
2026-03-28 18:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_da92dd95ed555d22e45baa6c4d18f84c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_e380a86e0d9fbbf3e2ddd654fd1f4de1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LW95470> (referer: https://www.auto1.com/v1/car-details-view/LW95470/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5ab25f10>
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_85903e1711699749ad7068d4fda967b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_85903e1711699749ad7068d4fda967b2.jpg saved to cache
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbbab10>
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_b4b05318e62b02f7c0bb21afeff6afc1.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_b4b05318e62b02f7c0bb21afeff6afc1.jpg saved to cache
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcd690>
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_d78d0d9b8bf8c3b3eb42d3848e6f1db7.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_d78d0d9b8bf8c3b3eb42d3848e6f1db7.jpg saved to cache
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b224310>
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_b94a97b5d13e53c329103c530ef13527.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_b94a97b5d13e53c329103c530ef13527.jpg saved to cache
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcd9d0>
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_411e2d0abc8c96e184e7c61f913eba3c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_411e2d0abc8c96e184e7c61f913eba3c.jpg saved to cache
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b270610>
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_c9410c154a0dc4203437610dd5f5c334.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_c9410c154a0dc4203437610dd5f5c334.jpg saved to cache
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b003490>
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_da92dd95ed555d22e45baa6c4d18f84c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_da92dd95ed555d22e45baa6c4d18f84c.jpg saved to cache
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b01a310>
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_e380a86e0d9fbbf3e2ddd654fd1f4de1.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_e380a86e0d9fbbf3e2ddd654fd1f4de1.jpg saved to cache
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98457537-d509-5bbf-84e2-4bea553106a9 with identifier: LW95470
2026-03-28 18:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98457537-d509-5bbf-84e2-4bea553106a9 with scrape type 1
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_b8f032d24d7b40a6746bcea22dc8e8e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_b8f032d24d7b40a6746bcea22dc8e8e8.jpg not downloaded yet
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_1946b928ef52ecf027f48c1e9126ee6f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_1946b928ef52ecf027f48c1e9126ee6f.jpg not downloaded yet
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_5c13419a14b846727fa280d96c3ed812.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_5c13419a14b846727fa280d96c3ed812.jpg not downloaded yet
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_186db42875bbd5c722e3d7158f7334ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_186db42875bbd5c722e3d7158f7334ae.jpg not downloaded yet
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_7b7ab820cb97a4b8714064c6ba63d63c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_7b7ab820cb97a4b8714064c6ba63d63c.jpg not downloaded yet
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_9e50eb0f5448e1abe9c41dc875e7f94f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_9e50eb0f5448e1abe9c41dc875e7f94f.jpg not downloaded yet
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_0b2df63aba93f52bbeb96874df2fd9c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_0b2df63aba93f52bbeb96874df2fd9c8.jpg not downloaded yet
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_b8f032d24d7b40a6746bcea22dc8e8e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_035b132e01f1fcda0542c61eb7a34ae8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_035b132e01f1fcda0542c61eb7a34ae8.jpg not downloaded yet
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_bfd36a60aeb85e6a66abf4d1066a1e11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_bfd36a60aeb85e6a66abf4d1066a1e11.jpg not downloaded yet
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_97189dc415c9822e41f24f39820241c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_97189dc415c9822e41f24f39820241c6.jpg not downloaded yet
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_ff90d9d11023f14814310e3b1d640b07.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b5e8950c4932ec17ba22eaf3a0980aa5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_6e586d23422319deb5ef71b175b22b53.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_98cb31eaea0d49a983c55965d0563174.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b7ace548dd112824ecbd1877d7674794.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd7ac50>
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_b8f032d24d7b40a6746bcea22dc8e8e8.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_b8f032d24d7b40a6746bcea22dc8e8e8.jpg saved to cache
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_1946b928ef52ecf027f48c1e9126ee6f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_5c13419a14b846727fa280d96c3ed812.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf5550>
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_ff90d9d11023f14814310e3b1d640b07.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_ff90d9d11023f14814310e3b1d640b07.jpg saved to cache
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_186db42875bbd5c722e3d7158f7334ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bce7950>
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_b5e8950c4932ec17ba22eaf3a0980aa5.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b5e8950c4932ec17ba22eaf3a0980aa5.jpg saved to cache
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b000f10>
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F3b%252Fa73bf97ad3f0206e4916afa4d64639df%252Fpa%252FNG66001_6e586d23422319deb5ef71b175b22b53.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_6e586d23422319deb5ef71b175b22b53.jpg saved to cache
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 22a47020-25f8-5550-9736-fd11cd8796bf
2026-03-28 18:39:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22a47020-25f8-5550-9736-fd11cd8796bf, skipping ID generation
2026-03-28 18:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22a47020-25f8-5550-9736-fd11cd8796bf with scrape type 1
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22a47020-25f8-5550-9736-fd11cd8796bf sending to next pipeline
2026-03-28 18:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22a47020-25f8-5550-9736-fd11cd8796bf, identifier: NG66001
2026-03-28 18:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc5c4d0>
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_98cb31eaea0d49a983c55965d0563174.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_98cb31eaea0d49a983c55965d0563174.jpg saved to cache
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b225190>
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fa8%252Fbfa8ecfe54ab9cd9ce3ae161cb9a9902%252Fpa%252FYT21216_b7ace548dd112824ecbd1877d7674794.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b7ace548dd112824ecbd1877d7674794.jpg saved to cache
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e385d2c-486e-5d88-9f27-ac483a1da53b
2026-03-28 18:39:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e385d2c-486e-5d88-9f27-ac483a1da53b, skipping ID generation
2026-03-28 18:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e385d2c-486e-5d88-9f27-ac483a1da53b with scrape type 1
2026-03-28 18:39:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e385d2c-486e-5d88-9f27-ac483a1da53b sending to next pipeline
2026-03-28 18:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e385d2c-486e-5d88-9f27-ac483a1da53b, identifier: YT21216
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcc610>
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_1946b928ef52ecf027f48c1e9126ee6f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_1946b928ef52ecf027f48c1e9126ee6f.jpg saved to cache
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbe98d0>
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_5c13419a14b846727fa280d96c3ed812.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_5c13419a14b846727fa280d96c3ed812.jpg saved to cache
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_97189dc415c9822e41f24f39820241c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22a47020-25f8-5550-9736-fd11cd8796bf with identifier: NG66001
2026-03-28 18:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22a47020-25f8-5550-9736-fd11cd8796bf with identifier: NG66001
2026-03-28 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22a47020-25f8-5550-9736-fd11cd8796bf with identifier: NG66001 to the API
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_6e586d23422319deb5ef71b175b22b53.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:11:35Z',
 'fuel_type': 'diesel',
 'id': '22a47020-25f8-5550-9736-fd11cd8796bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG66001',
 'listing': 'auction',
 'location': 'DE, Bremen',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 175706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2817296,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_b94a97b5d13e53c329103c530ef13527.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2615316,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_d78d0d9b8bf8c3b3eb42d3848e6f1db7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586228,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_b4b05318e62b02f7c0bb21afeff6afc1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2597184,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_411e2d0abc8c96e184e7c61f913eba3c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_aea8b0059682a0a5e03394cf25f9715d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78076,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_d2b31c4862d648fc38663737c809e266.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63847,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_1f03ae56cf65ccaa9363869f120fe6e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_ee4981c8fe7468ee304ec1400ffd7dee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_85903e1711699749ad7068d4fda967b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22a47020-25f8-5550-9736-fd11cd8796bf/22a47020-25f8-5550-9736-fd11cd8796bf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2424731,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/3b/a73bf97ad3f0206e4916afa4d64639df/pa/NG66001_6e586d23422319deb5ef71b175b22b53.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X1 sDrive 16d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG66001%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Saving data for NG66001: {'created_time': 1774723189.447937, 'last_price_update_time': 1774723189.447951, 'auction_closing_time': 1774883495.0}
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG66001') HTTP/1.1" 204 0
2026-03-28 18:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e385d2c-486e-5d88-9f27-ac483a1da53b with identifier: YT21216
2026-03-28 18:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e385d2c-486e-5d88-9f27-ac483a1da53b with identifier: YT21216
2026-03-28 18:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e385d2c-486e-5d88-9f27-ac483a1da53b with identifier: YT21216 to the API
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b7ace548dd112824ecbd1877d7674794.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:12Z',
 'fuel_type': 'diesel',
 'id': '8e385d2c-486e-5d88-9f27-ac483a1da53b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT21216',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 112896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_32e9899dc5e311d0ec8f88e9a938615c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_7b1878f351e6f9f135d7d4613073b9ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_9544c2f1b567f9fabc69eec3825f1c52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_c9410c154a0dc4203437610dd5f5c334.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b5e8950c4932ec17ba22eaf3a0980aa5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_da92dd95ed555d22e45baa6c4d18f84c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2606717,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_b7ace548dd112824ecbd1877d7674794.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_e380a86e0d9fbbf3e2ddd654fd1f4de1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2589348,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_98cb31eaea0d49a983c55965d0563174.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e385d2c-486e-5d88-9f27-ac483a1da53b/8e385d2c-486e-5d88-9f27-ac483a1da53b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/a8/bfa8ecfe54ab9cd9ce3ae161cb9a9902/pa/YT21216_ff90d9d11023f14814310e3b1d640b07.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT21216%27 HTTP/1.1" 200 None
2026-03-28 18:39:49 [auto1.de] INFO: Saving data for YT21216: {'created_time': 1774723189.827297, 'last_price_update_time': 1774723189.827309, 'auction_closing_time': 1774886052.0}
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT21216') HTTP/1.1" 204 0
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2fb610>
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_186db42875bbd5c722e3d7158f7334ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_186db42875bbd5c722e3d7158f7334ae.jpg saved to cache
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0e750>
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_97189dc415c9822e41f24f39820241c6.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_97189dc415c9822e41f24f39820241c6.jpg saved to cache
2026-03-28 18:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_0b2df63aba93f52bbeb96874df2fd9c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_7b7ab820cb97a4b8714064c6ba63d63c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_9e50eb0f5448e1abe9c41dc875e7f94f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_035b132e01f1fcda0542c61eb7a34ae8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_bfd36a60aeb85e6a66abf4d1066a1e11.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b286390>
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_0b2df63aba93f52bbeb96874df2fd9c8.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_0b2df63aba93f52bbeb96874df2fd9c8.jpg saved to cache
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b003950>
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_7b7ab820cb97a4b8714064c6ba63d63c.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_7b7ab820cb97a4b8714064c6ba63d63c.jpg saved to cache
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beef090>
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_9e50eb0f5448e1abe9c41dc875e7f94f.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_9e50eb0f5448e1abe9c41dc875e7f94f.jpg saved to cache
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d17d50>
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_035b132e01f1fcda0542c61eb7a34ae8.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_035b132e01f1fcda0542c61eb7a34ae8.jpg saved to cache
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdde0d0>
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:39:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg76%252F6b%252F766b905dad6af77a50f4431ef1490d6b%252Fpa%252FLW95470_bfd36a60aeb85e6a66abf4d1066a1e11.jpg') HTTP/1.1" 204 0
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_bfd36a60aeb85e6a66abf4d1066a1e11.jpg saved to cache
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98457537-d509-5bbf-84e2-4bea553106a9
2026-03-28 18:39:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98457537-d509-5bbf-84e2-4bea553106a9, skipping ID generation
2026-03-28 18:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98457537-d509-5bbf-84e2-4bea553106a9 with scrape type 1
2026-03-28 18:39:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98457537-d509-5bbf-84e2-4bea553106a9 sending to next pipeline
2026-03-28 18:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98457537-d509-5bbf-84e2-4bea553106a9, identifier: LW95470
2026-03-28 18:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98457537-d509-5bbf-84e2-4bea553106a9 with identifier: LW95470
2026-03-28 18:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98457537-d509-5bbf-84e2-4bea553106a9 with identifier: LW95470
2026-03-28 18:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98457537-d509-5bbf-84e2-4bea553106a9 with identifier: LW95470 to the API
2026-03-28 18:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_bfd36a60aeb85e6a66abf4d1066a1e11.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.8L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:32:13Z',
 'fuel_type': 'petrol',
 'id': '98457537-d509-5bbf-84e2-4bea553106a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW95470',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 210999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_b8f032d24d7b40a6746bcea22dc8e8e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_1946b928ef52ecf027f48c1e9126ee6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_5c13419a14b846727fa280d96c3ed812.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_186db42875bbd5c722e3d7158f7334ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3142860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_7b7ab820cb97a4b8714064c6ba63d63c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927188,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_9e50eb0f5448e1abe9c41dc875e7f94f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2834757,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_0b2df63aba93f52bbeb96874df2fd9c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3080036,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_035b132e01f1fcda0542c61eb7a34ae8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3038569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_bfd36a60aeb85e6a66abf4d1066a1e11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98457537-d509-5bbf-84e2-4bea553106a9/98457537-d509-5bbf-84e2-4bea553106a9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img76/6b/766b905dad6af77a50f4431ef1490d6b/pa/LW95470_97189dc415c9822e41f24f39820241c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A6 2.8 V6 FSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2011}
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW95470%27 HTTP/1.1" 200 None
2026-03-28 18:39:51 [auto1.de] INFO: Saving data for LW95470: {'created_time': 1774723191.240643, 'last_price_update_time': 1774723191.240655, 'auction_closing_time': 1774884733.0}
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW95470') HTTP/1.1" 204 0
2026-03-28 18:40:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:01 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 6004 | hits on page: 40
2026-03-28 18:40:01 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-28 18:40:01 [auto1.de] INFO: Scrape type for HM04559: 2
2026-03-28 18:40:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4714717b-f17e-5bb4-9324-9add99afcd07 with identifier: HM04559
2026-03-28 18:40:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4714717b-f17e-5bb4-9324-9add99afcd07 with scrape type 2
2026-03-28 18:40:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4714717b-f17e-5bb4-9324-9add99afcd07 with scrape type 2
2026-03-28 18:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4714717b-f17e-5bb4-9324-9add99afcd07, identifier: HM04559
2026-03-28 18:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4714717b-f17e-5bb4-9324-9add99afcd07 with identifier: HM04559
2026-03-28 18:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4714717b-f17e-5bb4-9324-9add99afcd07 with identifier: HM04559
2026-03-28 18:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4714717b-f17e-5bb4-9324-9add99afcd07 with identifier: HM04559 to the API
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:58Z',
 'fuel_type': 'petrol',
 'id': '4714717b-f17e-5bb4-9324-9add99afcd07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM04559',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 28870,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-30',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2024}
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM04559%27 HTTP/1.1" 200 None
2026-03-28 18:40:02 [auto1.de] INFO: Saving data for HM04559: {'auction_closing_time': 1774884838.0, 'created_time': 1773469049.303585, 'last_price_update_time': 1774723202.327875}
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM04559') HTTP/1.1" 204 0
2026-03-28 18:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-28 18:40:02 [auto1.de] INFO: Scrape type for CE21106: 1
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-28 18:40:02 [auto1.de] INFO: Scrape type for BN42758: 1
2026-03-28 18:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-28 18:40:02 [auto1.de] INFO: Scrape type for ZH67756: 1
2026-03-28 18:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-28 18:40:02 [auto1.de] INFO: Scrape type for PN96283: 1
2026-03-28 18:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-28 18:40:02 [auto1.de] INFO: Scrape type for KZ38664: 1
2026-03-28 18:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-28 18:40:02 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-28 18:40:02 [auto1.de] INFO: Scrape type for MF03624: 2
2026-03-28 18:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with identifier: MF03624
2026-03-28 18:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with scrape type 2
2026-03-28 18:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with scrape type 2
2026-03-28 18:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0, identifier: MF03624
2026-03-28 18:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with identifier: MF03624
2026-03-28 18:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with identifier: MF03624
2026-03-28 18:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44eb5f9d-6c08-5389-b999-e0ce7c6d64a0 with identifier: MF03624 to the API
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:41:31Z',
 'fuel_type': 'diesel',
 'id': '44eb5f9d-6c08-5389-b999-e0ce7c6d64a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF03624',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 342098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-16',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF03624%27 HTTP/1.1" 200 None
2026-03-28 18:40:02 [auto1.de] INFO: Saving data for MF03624: {'auction_closing_time': 1774885291.0, 'created_time': 1773467445.923024, 'last_price_update_time': 1774723202.912411}
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF03624') HTTP/1.1" 204 0
2026-03-28 18:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for EK32140: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: GE75594
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE75594%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for GE75594: 1
2026-03-28 18:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for BH61935: 1
2026-03-28 18:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for CV13370: 2
2026-03-28 18:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with identifier: CV13370
2026-03-28 18:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with scrape type 2
2026-03-28 18:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with scrape type 2
2026-03-28 18:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc, identifier: CV13370
2026-03-28 18:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with identifier: CV13370
2026-03-28 18:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with identifier: CV13370
2026-03-28 18:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc with identifier: CV13370 to the API
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:27:09Z',
 'fuel_type': 'petrol',
 'id': '47e9b3a1-bf8f-5acf-a105-5ac0cb566dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV13370',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 29992,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-24',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2017}
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV13370%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Saving data for CV13370: {'auction_closing_time': 1774884429.0, 'created_time': 1773428131.817724, 'last_price_update_time': 1774723203.550416}
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV13370') HTTP/1.1" 204 0
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for GF54025: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for KK05104: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for DT00553: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for GM93554: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for KC33777: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for JD18961: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for EU91257: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: XK86012
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK86012%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for XK86012: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-28 18:40:03 [auto1.de] INFO: Scrape type for MJ24427: 1
2026-03-28 18:40:03 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-28 18:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZH67756/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN42758/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE21106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GE75594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ38664/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:04 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 6004 | hits on page: 40
2026-03-28 18:40:04 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Scrape type for TY73105: 1
2026-03-28 18:40:04 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Scrape type for ZC07667: 2
2026-03-28 18:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with identifier: ZC07667
2026-03-28 18:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with scrape type 2
2026-03-28 18:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with scrape type 2
2026-03-28 18:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50, identifier: ZC07667
2026-03-28 18:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with identifier: ZC07667
2026-03-28 18:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with identifier: ZC07667
2026-03-28 18:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b8fdb8f-c622-5102-b2a9-2d4e1967df50 with identifier: ZC07667 to the API
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:38:12Z',
 'fuel_type': 'diesel',
 'id': '4b8fdb8f-c622-5102-b2a9-2d4e1967df50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC07667',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 142968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-08',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC07667%27 HTTP/1.1" 200 None
2026-03-28 18:40:04 [auto1.de] INFO: Saving data for ZC07667: {'auction_closing_time': 1774885092.0, 'created_time': 1774032632.249057, 'last_price_update_time': 1774723204.978824}
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC07667') HTTP/1.1" 204 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for RY65257: 1
2026-03-28 18:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK32140/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: VF76211
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF76211%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for VF76211: 1
2026-03-28 18:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN96283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for AN00284: 1
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for PW75443: 2
2026-03-28 18:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21b1df75-26f8-5284-937f-83bd974e1912 with identifier: PW75443
2026-03-28 18:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21b1df75-26f8-5284-937f-83bd974e1912 with scrape type 2
2026-03-28 18:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21b1df75-26f8-5284-937f-83bd974e1912 with scrape type 2
2026-03-28 18:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21b1df75-26f8-5284-937f-83bd974e1912, identifier: PW75443
2026-03-28 18:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21b1df75-26f8-5284-937f-83bd974e1912 with identifier: PW75443
2026-03-28 18:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21b1df75-26f8-5284-937f-83bd974e1912 with identifier: PW75443
2026-03-28 18:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21b1df75-26f8-5284-937f-83bd974e1912 with identifier: PW75443 to the API
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:21Z',
 'fuel_type': 'diesel',
 'id': '21b1df75-26f8-5284-937f-83bd974e1912',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW75443',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 196150,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-11',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW75443%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Saving data for PW75443: {'auction_closing_time': 1774885521.0, 'created_time': 1773402087.640786, 'last_price_update_time': 1774723205.61412}
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PW75443') HTTP/1.1" 204 0
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for XZ09557: 1
2026-03-28 18:40:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF54025/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:05 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-28 18:40:05 [auto1.de] INFO: Scrape type for ZU51849: 2
2026-03-28 18:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700627a8-842e-5cdc-a12a-9c4516c95d74 with identifier: ZU51849
2026-03-28 18:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700627a8-842e-5cdc-a12a-9c4516c95d74 with scrape type 2
2026-03-28 18:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 700627a8-842e-5cdc-a12a-9c4516c95d74 with scrape type 2
2026-03-28 18:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 700627a8-842e-5cdc-a12a-9c4516c95d74, identifier: ZU51849
2026-03-28 18:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 700627a8-842e-5cdc-a12a-9c4516c95d74 with identifier: ZU51849
2026-03-28 18:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 700627a8-842e-5cdc-a12a-9c4516c95d74 with identifier: ZU51849
2026-03-28 18:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 700627a8-842e-5cdc-a12a-9c4516c95d74 with identifier: ZU51849 to the API
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:26:18Z',
 'fuel_type': 'diesel',
 'id': '700627a8-842e-5cdc-a12a-9c4516c95d74',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU51849',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 136797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-28',
 'seller_name': None,
 'title': 'Audi A6 40 TDI Mild-Hybrid Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU51849%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Saving data for ZU51849: {'auction_closing_time': 1774884378.0, 'created_time': 1773468759.148005, 'last_price_update_time': 1774723206.16713}
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU51849') HTTP/1.1" 204 0
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for VS08295: 1
2026-03-28 18:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BH61935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT00553/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for DZ10370: 1
2026-03-28 18:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for LH85097: 1
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM06899%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for ZM06899: 1
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for MW28967: 1
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for ZB32219: 1
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for HL71303: 2
2026-03-28 18:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with identifier: HL71303
2026-03-28 18:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with scrape type 2
2026-03-28 18:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with scrape type 2
2026-03-28 18:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae, identifier: HL71303
2026-03-28 18:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with identifier: HL71303
2026-03-28 18:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with identifier: HL71303
2026-03-28 18:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b80f9cdf-17ba-5b20-9dd5-834b1003a5ae with identifier: HL71303 to the API
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:09Z',
 'fuel_type': 'petrol',
 'id': 'b80f9cdf-17ba-5b20-9dd5-834b1003a5ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL71303',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 82647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL71303%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Saving data for HL71303: {'auction_closing_time': 1774886349.0, 'created_time': 1774349889.843832, 'last_price_update_time': 1774723206.718413}
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL71303') HTTP/1.1" 204 0
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for HP58071: 1
2026-03-28 18:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK05104/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GM93554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-28 18:40:06 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-28 18:40:06 [auto1.de] INFO: Scrape type for DZ90314: 2
2026-03-28 18:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with identifier: DZ90314
2026-03-28 18:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with scrape type 2
2026-03-28 18:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with scrape type 2
2026-03-28 18:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29, identifier: DZ90314
2026-03-28 18:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC33777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with identifier: DZ90314
2026-03-28 18:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with identifier: DZ90314
2026-03-28 18:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 25f5bd6c-8df4-5028-9f3b-bcfeb241ee29 with identifier: DZ90314 to the API
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:21:19Z',
 'fuel_type': 'diesel',
 'id': '25f5bd6c-8df4-5028-9f3b-bcfeb241ee29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ90314',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Caravelle',
 'odometer': 234234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-13',
 'seller_name': None,
 'title': 'Volkswagen T5 Caravelle 2.0 TDI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ90314%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Saving data for DZ90314: {'auction_closing_time': 1774884079.0, 'created_time': 1774349900.862335, 'last_price_update_time': 1774723207.3183}
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ90314') HTTP/1.1" 204 0
2026-03-28 18:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for ZD05213: 1
2026-03-28 18:40:07 [scrapy.extensions.logstats] INFO: Crawled 338 pages (at 55 pages/min), scraped 583 items (at 48 items/min)
2026-03-28 18:40:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-28 18:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD18961/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for WC53392: 2
2026-03-28 18:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8287f57a-5e30-55bc-95d2-243e8e47ba10 with identifier: WC53392
2026-03-28 18:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8287f57a-5e30-55bc-95d2-243e8e47ba10 with scrape type 2
2026-03-28 18:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8287f57a-5e30-55bc-95d2-243e8e47ba10 with scrape type 2
2026-03-28 18:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8287f57a-5e30-55bc-95d2-243e8e47ba10, identifier: WC53392
2026-03-28 18:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU91257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8287f57a-5e30-55bc-95d2-243e8e47ba10 with identifier: WC53392
2026-03-28 18:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8287f57a-5e30-55bc-95d2-243e8e47ba10 with identifier: WC53392
2026-03-28 18:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8287f57a-5e30-55bc-95d2-243e8e47ba10 with identifier: WC53392 to the API
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:21:02Z',
 'fuel_type': 'petrol',
 'id': '8287f57a-5e30-55bc-95d2-243e8e47ba10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC53392',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 111754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-26',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC53392%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Saving data for WC53392: {'auction_closing_time': 1774884062.0, 'created_time': 1773467164.444175, 'last_price_update_time': 1774723207.823128}
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC53392') HTTP/1.1" 204 0
2026-03-28 18:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-28 18:40:07 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-28 18:40:07 [auto1.de] INFO: Scrape type for JZ33625: 2
2026-03-28 18:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa27d5cc-600d-567d-b05c-e529cd2883e2 with identifier: JZ33625
2026-03-28 18:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa27d5cc-600d-567d-b05c-e529cd2883e2 with scrape type 2
2026-03-28 18:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa27d5cc-600d-567d-b05c-e529cd2883e2 with scrape type 2
2026-03-28 18:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa27d5cc-600d-567d-b05c-e529cd2883e2, identifier: JZ33625
2026-03-28 18:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa27d5cc-600d-567d-b05c-e529cd2883e2 with identifier: JZ33625
2026-03-28 18:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa27d5cc-600d-567d-b05c-e529cd2883e2 with identifier: JZ33625
2026-03-28 18:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa27d5cc-600d-567d-b05c-e529cd2883e2 with identifier: JZ33625 to the API
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:46:25Z',
 'fuel_type': 'diesel',
 'id': 'aa27d5cc-600d-567d-b05c-e529cd2883e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ33625',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 138669,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-01',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2019}
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [auto1.de] INFO: Saving data for JZ33625: {'auction_closing_time': 1774885585.0, 'created_time': 1773467098.109532, 'last_price_update_time': 1774723208.398828}
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ33625') HTTP/1.1" 204 0
2026-03-28 18:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ24427/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZH67756> (referer: https://www.auto1.com/v1/car-details-view/ZH67756/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XK86012/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with identifier: ZH67756
2026-03-28 18:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with scrape type 1
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_7b3d3d26e895c351cbc38866f3b17295.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_7b3d3d26e895c351cbc38866f3b17295.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_1633ac50cde5e0e68f4df091d4680d47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_1633ac50cde5e0e68f4df091d4680d47.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_217de3db719839ec3fe872ab9a55f952.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_217de3db719839ec3fe872ab9a55f952.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_03b4551577d2bc8a4717dc287c9c47a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_03b4551577d2bc8a4717dc287c9c47a2.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_5615cc164b2cafd5ab0b8d66cd0908f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_5615cc164b2cafd5ab0b8d66cd0908f6.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_0fbfdc27e15f44a620e94a19436f705e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_0fbfdc27e15f44a620e94a19436f705e.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_37d09a9f43d250494a5bd80cdda7414f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_37d09a9f43d250494a5bd80cdda7414f.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_ca93d5a52483c75d343e4f8dfb8cd071.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_ca93d5a52483c75d343e4f8dfb8cd071.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_586a6f66bbf4da173ff69f22320eaea9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_586a6f66bbf4da173ff69f22320eaea9.jpg not downloaded yet
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_0a839fadc50d9a50c13b8a973fa8213f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_0a839fadc50d9a50c13b8a973fa8213f.jpg not downloaded yet
2026-03-28 18:40:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY73105/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_0a839fadc50d9a50c13b8a973fa8213f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN42758> (referer: https://www.auto1.com/v1/car-details-view/BN42758/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bddcfd0>
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_0a839fadc50d9a50c13b8a973fa8213f.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_0a839fadc50d9a50c13b8a973fa8213f.jpg saved to cache
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS08295/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baa4af07-90cc-55c5-bb21-0632b7863ac9 with identifier: BN42758
2026-03-28 18:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa4af07-90cc-55c5-bb21-0632b7863ac9 with scrape type 1
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item baa4af07-90cc-55c5-bb21-0632b7863ac9
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_2fbaff38ac1d22024514e5e173f835bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_2fbaff38ac1d22024514e5e173f835bd.jpg not downloaded yet
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_93bf0c57bd1efdccea2b12f830bf38a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_93bf0c57bd1efdccea2b12f830bf38a1.jpg not downloaded yet
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_200f791a909afab1bfc72b73e53311b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_200f791a909afab1bfc72b73e53311b1.jpg not downloaded yet
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_586a6f66bbf4da173ff69f22320eaea9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_0ea6969bdf74883a558e5dadf6e83c1a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_0ea6969bdf74883a558e5dadf6e83c1a.jpg not downloaded yet
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ09557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_abcd0e0681ddb4a8e69d5f281c70d3d0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_abcd0e0681ddb4a8e69d5f281c70d3d0.jpg not downloaded yet
2026-03-28 18:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GE75594> (referer: https://www.auto1.com/v1/car-details-view/GE75594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF54025> (referer: https://www.auto1.com/v1/car-details-view/GF54025/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_ca93d5a52483c75d343e4f8dfb8cd071.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17fbd0>
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_586a6f66bbf4da173ff69f22320eaea9.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_586a6f66bbf4da173ff69f22320eaea9.jpg saved to cache
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_93bf0c57bd1efdccea2b12f830bf38a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_0ea6969bdf74883a558e5dadf6e83c1a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_abcd0e0681ddb4a8e69d5f281c70d3d0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_200f791a909afab1bfc72b73e53311b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 617edb04-356d-5359-8573-64b9d3cb0609 with identifier: GE75594
2026-03-28 18:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617edb04-356d-5359-8573-64b9d3cb0609 with scrape type 1
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_0aae372031e36ae6cf9b9275c3c0439a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0aae372031e36ae6cf9b9275c3c0439a.jpg not downloaded yet
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_164deae6c1e47643267c716f8aca0788.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_164deae6c1e47643267c716f8aca0788.jpg not downloaded yet
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_cf3a9c5725ad398635ae409722de8769.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_cf3a9c5725ad398635ae409722de8769.jpg not downloaded yet
2026-03-28 18:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with identifier: GF54025
2026-03-28 18:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with scrape type 1
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_569db1ea81c95dc95bc653b4e01fea2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_569db1ea81c95dc95bc653b4e01fea2f.jpg not downloaded yet
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb8cd0>
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_ca93d5a52483c75d343e4f8dfb8cd071.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_ca93d5a52483c75d343e4f8dfb8cd071.jpg saved to cache
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_2fbaff38ac1d22024514e5e173f835bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_0516cb63de00b94b127a924d730a3f5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0516cb63de00b94b127a924d730a3f5f.jpg not downloaded yet
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_20ee64dfc8683c3acd71d979ed60c09c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_20ee64dfc8683c3acd71d979ed60c09c.jpg not downloaded yet
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_64bc871bfd75f5a3df14769dacd45055.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_64bc871bfd75f5a3df14769dacd45055.jpg not downloaded yet
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_ca0dfd84b281c31304d5e71fc9b1e8b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_ca0dfd84b281c31304d5e71fc9b1e8b6.jpg not downloaded yet
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_629b50d8a40ae575c2f87f7b1a9f772d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_629b50d8a40ae575c2f87f7b1a9f772d.jpg not downloaded yet
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c7390>
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_93bf0c57bd1efdccea2b12f830bf38a1.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_93bf0c57bd1efdccea2b12f830bf38a1.jpg saved to cache
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item baa4af07-90cc-55c5-bb21-0632b7863ac9
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6d510>
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_0ea6969bdf74883a558e5dadf6e83c1a.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_0ea6969bdf74883a558e5dadf6e83c1a.jpg saved to cache
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item baa4af07-90cc-55c5-bb21-0632b7863ac9
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b28aad0>
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_abcd0e0681ddb4a8e69d5f281c70d3d0.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_abcd0e0681ddb4a8e69d5f281c70d3d0.jpg saved to cache
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item baa4af07-90cc-55c5-bb21-0632b7863ac9
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a9f50>
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_200f791a909afab1bfc72b73e53311b1.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_200f791a909afab1bfc72b73e53311b1.jpg saved to cache
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item baa4af07-90cc-55c5-bb21-0632b7863ac9
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_d3b2fe08c9d5f28784139d6431049fcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_d3b2fe08c9d5f28784139d6431049fcd.jpg not downloaded yet
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_0fbfdc27e15f44a620e94a19436f705e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_37d09a9f43d250494a5bd80cdda7414f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_c199e32d900bc32ee04d52a1c1edac03.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_c199e32d900bc32ee04d52a1c1edac03.jpg not downloaded yet
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_569db1ea81c95dc95bc653b4e01fea2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_17307d69c260341e3455e482cb5c88f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_17307d69c260341e3455e482cb5c88f8.jpg not downloaded yet
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT00553> (referer: https://www.auto1.com/v1/car-details-view/DT00553/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP58071/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_a005986327a5391d8198f2146f46e515.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_a005986327a5391d8198f2146f46e515.jpg not downloaded yet
2026-03-28 18:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2aa210>
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fc6%252F87c60c27805a481a1b0a3a9d95d27949%252Fpa%252FBN42758_2fbaff38ac1d22024514e5e173f835bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_2fbaff38ac1d22024514e5e173f835bd.jpg saved to cache
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baa4af07-90cc-55c5-bb21-0632b7863ac9
2026-03-28 18:40:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baa4af07-90cc-55c5-bb21-0632b7863ac9, skipping ID generation
2026-03-28 18:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baa4af07-90cc-55c5-bb21-0632b7863ac9 with scrape type 1
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baa4af07-90cc-55c5-bb21-0632b7863ac9 sending to next pipeline
2026-03-28 18:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: baa4af07-90cc-55c5-bb21-0632b7863ac9, identifier: BN42758
2026-03-28 18:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: baa4af07-90cc-55c5-bb21-0632b7863ac9 with identifier: BN42758
2026-03-28 18:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: baa4af07-90cc-55c5-bb21-0632b7863ac9 with identifier: BN42758
2026-03-28 18:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: baa4af07-90cc-55c5-bb21-0632b7863ac9 with identifier: BN42758 to the API
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_2fbaff38ac1d22024514e5e173f835bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:53:10Z',
 'fuel_type': 'petrol',
 'id': 'baa4af07-90cc-55c5-bb21-0632b7863ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN42758',
 'listing': 'auction',
 'location': 'DE, Schweinfurt',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 58840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_2fbaff38ac1d22024514e5e173f835bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_93bf0c57bd1efdccea2b12f830bf38a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_200f791a909afab1bfc72b73e53311b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_0ea6969bdf74883a558e5dadf6e83c1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baa4af07-90cc-55c5-bb21-0632b7863ac9/baa4af07-90cc-55c5-bb21-0632b7863ac9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89622,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/c6/87c60c27805a481a1b0a3a9d95d27949/pa/BN42758_abcd0e0681ddb4a8e69d5f281c70d3d0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-11-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Enjoy',
 'transmission': 'automatic',
 'trim': 'Enjoy',
 'year': 2003}
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN42758%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [auto1.de] INFO: Saving data for BN42758: {'created_time': 1774723210.517506, 'last_price_update_time': 1774723210.51752, 'auction_closing_time': 1774885990.0}
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN42758') HTTP/1.1" 204 0
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_125955b14e0f42e27f5707bc7697ea92.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_125955b14e0f42e27f5707bc7697ea92.jpg not downloaded yet
2026-03-28 18:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_d3b2fe08c9d5f28784139d6431049fcd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_ca0dfd84b281c31304d5e71fc9b1e8b6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b102f50>
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_0fbfdc27e15f44a620e94a19436f705e.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_0fbfdc27e15f44a620e94a19436f705e.jpg saved to cache
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0edd0>
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_37d09a9f43d250494a5bd80cdda7414f.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_37d09a9f43d250494a5bd80cdda7414f.jpg saved to cache
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc31bd0>
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_569db1ea81c95dc95bc653b4e01fea2f.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_569db1ea81c95dc95bc653b4e01fea2f.jpg saved to cache
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7
2026-03-28 18:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae128549-0740-5806-8223-bae72e58b6c5 with identifier: DT00553
2026-03-28 18:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae128549-0740-5806-8223-bae72e58b6c5 with scrape type 1
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae128549-0740-5806-8223-bae72e58b6c5
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_9675cfc69f5d222bc1029ca83712e67e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_9675cfc69f5d222bc1029ca83712e67e.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_7e513403fb7cc4b218cc67e731aab6c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_7e513403fb7cc4b218cc67e731aab6c1.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_230c7612f281e75bcc1af9eecd967ef6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_230c7612f281e75bcc1af9eecd967ef6.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_6d6470b28750497b48c55e92a3edee9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_6d6470b28750497b48c55e92a3edee9c.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_c6a7247a8364646f36a3c59aeec4979b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_c6a7247a8364646f36a3c59aeec4979b.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_a90c391bb52dabe6b9a95d49bd43375b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_a90c391bb52dabe6b9a95d49bd43375b.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_ecb0b2a83e7aeb6215f4a0fac602033f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_ecb0b2a83e7aeb6215f4a0fac602033f.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_7d2d14cccf2f1d978ba7363760a7b76c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_7d2d14cccf2f1d978ba7363760a7b76c.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_05d3433b7df3db0da379b3e5d0557f4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_05d3433b7df3db0da379b3e5d0557f4c.jpg already downloaded
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg26%252Ff0%252F26f07384378cf6d7c79a3c16b421cf14%252Fpa%252FDT00553_117caf58b61bbf3b8b94a49f45267bd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_117caf58b61bbf3b8b94a49f45267bd7.jpg already downloaded
2026-03-28 18:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae128549-0740-5806-8223-bae72e58b6c5, identifier: DT00553
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_c7b9b69c1ae32ab047de4bc621e6b00f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_c7b9b69c1ae32ab047de4bc621e6b00f.jpg not downloaded yet
2026-03-28 18:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BH61935> (referer: https://www.auto1.com/v1/car-details-view/BH61935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD05213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GM93554> (referer: https://www.auto1.com/v1/car-details-view/GM93554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae128549-0740-5806-8223-bae72e58b6c5 with identifier: DT00553
2026-03-28 18:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae128549-0740-5806-8223-bae72e58b6c5 with identifier: DT00553
2026-03-28 18:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae128549-0740-5806-8223-bae72e58b6c5 with identifier: DT00553 to the API
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DT00553>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:45Z',
 'fuel_type': 'diesel',
 'id': 'ae128549-0740-5806-8223-bae72e58b6c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT00553',
 'listing': 'auction',
 'location': 'DE, Kippenheim',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 201865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_9675cfc69f5d222bc1029ca83712e67e.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_7e513403fb7cc4b218cc67e731aab6c1.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_230c7612f281e75bcc1af9eecd967ef6.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_6d6470b28750497b48c55e92a3edee9c.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_c6a7247a8364646f36a3c59aeec4979b.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_a90c391bb52dabe6b9a95d49bd43375b.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_ecb0b2a83e7aeb6215f4a0fac602033f.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_7d2d14cccf2f1d978ba7363760a7b76c.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_05d3433b7df3db0da379b3e5d0557f4c.jpg',
                'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_117caf58b61bbf3b8b94a49f45267bd7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2507526,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_9675cfc69f5d222bc1029ca83712e67e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2394945,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_7e513403fb7cc4b218cc67e731aab6c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438714,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_230c7612f281e75bcc1af9eecd967ef6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2359023,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_6d6470b28750497b48c55e92a3edee9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2535686,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_c6a7247a8364646f36a3c59aeec4979b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1987294,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_a90c391bb52dabe6b9a95d49bd43375b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1860860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_ecb0b2a83e7aeb6215f4a0fac602033f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2051998,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_7d2d14cccf2f1d978ba7363760a7b76c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2254009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_05d3433b7df3db0da379b3e5d0557f4c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ae128549-0740-5806-8223-bae72e58b6c5/ae128549-0740-5806-8223-bae72e58b6c5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2185167,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img26/f0/26f07384378cf6d7c79a3c16b421cf14/pa/DT00553_117caf58b61bbf3b8b94a49f45267bd7.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2020}
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT00553%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [auto1.de] INFO: Saving data for DT00553: {'created_time': 1774723211.273667, 'last_price_update_time': 1774723211.273678, 'auction_closing_time': 1774885605.0}
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT00553') HTTP/1.1" 204 0
2026-03-28 18:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb6b2d0>
2026-03-28 18:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_d3b2fe08c9d5f28784139d6431049fcd.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_d3b2fe08c9d5f28784139d6431049fcd.jpg saved to cache
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7
2026-03-28 18:40:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc30c50>
2026-03-28 18:40:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_ca0dfd84b281c31304d5e71fc9b1e8b6.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_ca0dfd84b281c31304d5e71fc9b1e8b6.jpg saved to cache
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7
2026-03-28 18:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU91257> (referer: https://www.auto1.com/v1/car-details-view/EU91257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ38664> (referer: https://www.auto1.com/v1/car-details-view/KZ38664/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4166df80-56af-5b93-9dbd-2fae34c82122 with identifier: BH61935
2026-03-28 18:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4166df80-56af-5b93-9dbd-2fae34c82122 with scrape type 1
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4166df80-56af-5b93-9dbd-2fae34c82122
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_1d9ac1c540fe2fdd419a0a621bcb32dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_1d9ac1c540fe2fdd419a0a621bcb32dc.jpg not downloaded yet
2026-03-28 18:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb14d324-85de-5ec9-9d43-c364e28b79c6 with identifier: GM93554
2026-03-28 18:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb14d324-85de-5ec9-9d43-c364e28b79c6 with scrape type 1
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb14d324-85de-5ec9-9d43-c364e28b79c6
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_b71aa348caff50e940b13260bbfc1229.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_b71aa348caff50e940b13260bbfc1229.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_5c01effcd1190c6a2ec9d9bdf8830ee1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_5c01effcd1190c6a2ec9d9bdf8830ee1.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_1376154f566538320f91a4052bc6e06a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_1376154f566538320f91a4052bc6e06a.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_a017b0fe990817a708049adfb47b7c37.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_a017b0fe990817a708049adfb47b7c37.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_79af51b3931c967f9b8a5748c1807f64.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_79af51b3931c967f9b8a5748c1807f64.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_56cbad31eb1f27c0b155a4a28eec1b43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_56cbad31eb1f27c0b155a4a28eec1b43.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_54c435f2d3ab2af1105e4530b3ef2cea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_54c435f2d3ab2af1105e4530b3ef2cea.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_917e2c2b08ad055b42fefd2ed0db8073.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_917e2c2b08ad055b42fefd2ed0db8073.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_29ab13f506ac7e88dd99ad45c7ef41ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_29ab13f506ac7e88dd99ad45c7ef41ec.jpg already downloaded
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F5e%252F6d5e00ce50452be6af8c7850bfa2538d%252Fpa%252FGM93554_c453bf38ede9e41346ff4949a03d3a22.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_c453bf38ede9e41346ff4949a03d3a22.jpg already downloaded
2026-03-28 18:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb14d324-85de-5ec9-9d43-c364e28b79c6, identifier: GM93554
2026-03-28 18:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb14d324-85de-5ec9-9d43-c364e28b79c6 with identifier: GM93554
2026-03-28 18:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb14d324-85de-5ec9-9d43-c364e28b79c6 with identifier: GM93554
2026-03-28 18:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb14d324-85de-5ec9-9d43-c364e28b79c6 with identifier: GM93554 to the API
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GM93554>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:41:36Z',
 'fuel_type': 'petrol',
 'id': 'cb14d324-85de-5ec9-9d43-c364e28b79c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM93554',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 121207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_b71aa348caff50e940b13260bbfc1229.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_5c01effcd1190c6a2ec9d9bdf8830ee1.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_1376154f566538320f91a4052bc6e06a.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_a017b0fe990817a708049adfb47b7c37.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_79af51b3931c967f9b8a5748c1807f64.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_56cbad31eb1f27c0b155a4a28eec1b43.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_54c435f2d3ab2af1105e4530b3ef2cea.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_917e2c2b08ad055b42fefd2ed0db8073.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_29ab13f506ac7e88dd99ad45c7ef41ec.jpg',
                'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_c453bf38ede9e41346ff4949a03d3a22.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3069708,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_b71aa348caff50e940b13260bbfc1229.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3242404,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_5c01effcd1190c6a2ec9d9bdf8830ee1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_1376154f566538320f91a4052bc6e06a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73556,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_a017b0fe990817a708049adfb47b7c37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_79af51b3931c967f9b8a5748c1807f64.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2991367,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_56cbad31eb1f27c0b155a4a28eec1b43.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3034168,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_54c435f2d3ab2af1105e4530b3ef2cea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3060101,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_917e2c2b08ad055b42fefd2ed0db8073.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017378,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_29ab13f506ac7e88dd99ad45c7ef41ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb14d324-85de-5ec9-9d43-c364e28b79c6/cb14d324-85de-5ec9-9d43-c364e28b79c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3045001,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/5e/6d5e00ce50452be6af8c7850bfa2538d/pa/GM93554_c453bf38ede9e41346ff4949a03d3a22.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2017}
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93554%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Saving data for GM93554: {'created_time': 1774723212.034537, 'last_price_update_time': 1774723212.034548, 'auction_closing_time': 1774885296.0}
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM93554') HTTP/1.1" 204 0
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_125955b14e0f42e27f5707bc7697ea92.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_39c5b229e0ffd63418169a748650e39c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_39c5b229e0ffd63418169a748650e39c.jpg not downloaded yet
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_20ee64dfc8683c3acd71d979ed60c09c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_a005986327a5391d8198f2146f46e515.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:12 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 6005 | hits on page: 40
2026-03-28 18:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84eebff7-5356-582c-a98d-defdbfe75918 with identifier: EU91257
2026-03-28 18:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84eebff7-5356-582c-a98d-defdbfe75918 with scrape type 1
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_40a7b1264c2504ec416d3a78603389c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_40a7b1264c2504ec416d3a78603389c2.jpg not downloaded yet
2026-03-28 18:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72524a46-7194-594f-be70-a205886bb213 with identifier: KZ38664
2026-03-28 18:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72524a46-7194-594f-be70-a205886bb213 with scrape type 1
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 72524a46-7194-594f-be70-a205886bb213
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_b8d5fa857565c5bd20379e7d1ae8b403.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_b8d5fa857565c5bd20379e7d1ae8b403.jpg not downloaded yet
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_17307d69c260341e3455e482cb5c88f8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_9f868767741829d7231cf76231147915.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_9f868767741829d7231cf76231147915.jpg not downloaded yet
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ33625%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for JZ33625: 0
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for SS01468: 1
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_28914bdc5126137dd5dffb2369654109.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_28914bdc5126137dd5dffb2369654109.jpg not downloaded yet
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_999eddf8151def617c4a406109104ed8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_999eddf8151def617c4a406109104ed8.jpg not downloaded yet
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC33777> (referer: https://www.auto1.com/v1/car-details-view/KC33777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD18961> (referer: https://www.auto1.com/v1/car-details-view/JD18961/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_00927cf20faf3208c6b22d19ccba2f2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_00927cf20faf3208c6b22d19ccba2f2b.jpg not downloaded yet
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for VU61436: 1
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_2b46d64c6ada8fa7cd4574c95c305261.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_2b46d64c6ada8fa7cd4574c95c305261.jpg not downloaded yet
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_196655b6c2cfd49fa14e846835ab1ba4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_196655b6c2cfd49fa14e846835ab1ba4.jpg not downloaded yet
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c8f50>
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_125955b14e0f42e27f5707bc7697ea92.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_125955b14e0f42e27f5707bc7697ea92.jpg saved to cache
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcdd50>
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_20ee64dfc8683c3acd71d979ed60c09c.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_20ee64dfc8683c3acd71d979ed60c09c.jpg saved to cache
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b077290>
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_a005986327a5391d8198f2146f46e515.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_a005986327a5391d8198f2146f46e515.jpg saved to cache
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_1d9ac1c540fe2fdd419a0a621bcb32dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0516cb63de00b94b127a924d730a3f5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_f155ae72d64b49a166f77524fd674878.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_f155ae72d64b49a166f77524fd674878.jpg not downloaded yet
2026-03-28 18:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_164deae6c1e47643267c716f8aca0788.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-28 18:40:12 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [auto1.de] INFO: Scrape type for YD79813: 1
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_b9df22768e2694d55f37cd9d44ff5534.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_b9df22768e2694d55f37cd9d44ff5534.jpg not downloaded yet
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_bcdd13498e05655a3fb706c32528a53c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_bcdd13498e05655a3fb706c32528a53c.jpg not downloaded yet
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_817533a4254388513c88f55c163778bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_817533a4254388513c88f55c163778bb.jpg not downloaded yet
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10b810>
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgca%252Fed%252Fcaed784e969eb87e787266ede6a7d8a9%252Fpa%252FGF54025_17307d69c260341e3455e482cb5c88f8.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_17307d69c260341e3455e482cb5c88f8.jpg saved to cache
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7
2026-03-28 18:40:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d03c9d5-a72a-5e8e-8899-de3555e642e7, skipping ID generation
2026-03-28 18:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with scrape type 1
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d03c9d5-a72a-5e8e-8899-de3555e642e7 sending to next pipeline
2026-03-28 18:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d03c9d5-a72a-5e8e-8899-de3555e642e7, identifier: GF54025
2026-03-28 18:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4058d925-3f8f-52fe-bbca-ff9100299fde with identifier: KC33777
2026-03-28 18:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4058d925-3f8f-52fe-bbca-ff9100299fde with scrape type 1
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4058d925-3f8f-52fe-bbca-ff9100299fde
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_8ed637fff088c11642d63eb6bf4c189d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_8ed637fff088c11642d63eb6bf4c189d.jpg already downloaded
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_512980fa0e357899e15e92085fcdaa2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_512980fa0e357899e15e92085fcdaa2a.jpg already downloaded
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_a22b649f4e696fe8a1b88d0e71df7fa4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_a22b649f4e696fe8a1b88d0e71df7fa4.jpg already downloaded
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_43fa95a5989fda2a893b638b80c2d937.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_43fa95a5989fda2a893b638b80c2d937.jpg already downloaded
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_1aed6617c8ab0e369baaab851552a1bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_1aed6617c8ab0e369baaab851552a1bf.jpg already downloaded
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_230dcc4f6da0355dbb9e7aeadee873be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_230dcc4f6da0355dbb9e7aeadee873be.jpg already downloaded
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_1f8ad41c3e7265b5417370c891b6b6f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_1f8ad41c3e7265b5417370c891b6b6f5.jpg already downloaded
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_22351ed825ec806dd45a60e6873ab070.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_22351ed825ec806dd45a60e6873ab070.jpg already downloaded
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_4575425b21a3791ef3cf21eac6ea94a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_4575425b21a3791ef3cf21eac6ea94a2.jpg already downloaded
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F72%252F8472f8537004d04e5ff74ed4345b25c7%252Fpa%252FKC33777_9e6804a39c9903f9f3db72d9319dad2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_9e6804a39c9903f9f3db72d9319dad2b.jpg already downloaded
2026-03-28 18:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4058d925-3f8f-52fe-bbca-ff9100299fde, identifier: KC33777
2026-03-28 18:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beda420c-e987-5fc4-a7ac-944edc08e34e with identifier: JD18961
2026-03-28 18:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beda420c-e987-5fc4-a7ac-944edc08e34e with scrape type 1
2026-03-28 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_5e682ffca5441a10f3fc5c81c90fd7a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_5e682ffca5441a10f3fc5c81c90fd7a3.jpg not downloaded yet
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-28 18:40:13 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Scrape type for JR23306: 1
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_54193b08587f5eacf43674c2483601e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_54193b08587f5eacf43674c2483601e9.jpg not downloaded yet
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_7673fbd9975ea076721adaf4a14f4b7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_7673fbd9975ea076721adaf4a14f4b7b.jpg not downloaded yet
2026-03-28 18:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with identifier: GF54025
2026-03-28 18:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with identifier: GF54025
2026-03-28 18:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d03c9d5-a72a-5e8e-8899-de3555e642e7 with identifier: GF54025 to the API
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_17307d69c260341e3455e482cb5c88f8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'petrol',
 'id': '6d03c9d5-a72a-5e8e-8899-de3555e642e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF54025',
 'listing': 'auction',
 'location': 'DE, Böblingen',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 181499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_569db1ea81c95dc95bc653b4e01fea2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_20ee64dfc8683c3acd71d979ed60c09c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_ca0dfd84b281c31304d5e71fc9b1e8b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63318,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_d3b2fe08c9d5f28784139d6431049fcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d03c9d5-a72a-5e8e-8899-de3555e642e7/6d03c9d5-a72a-5e8e-8899-de3555e642e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 142825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgca/ed/caed784e969eb87e787266ede6a7d8a9/pa/GF54025_17307d69c260341e3455e482cb5c88f8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-05-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.6 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2007}
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54025%27 HTTP/1.1" 200 None
2026-03-28 18:40:13 [auto1.de] INFO: Saving data for GF54025: {'created_time': 1774723213.632803, 'last_price_update_time': 1774723213.632817, 'auction_closing_time': 1774883102.0}
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF54025') HTTP/1.1" 204 0
2026-03-28 18:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4058d925-3f8f-52fe-bbca-ff9100299fde with identifier: KC33777
2026-03-28 18:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4058d925-3f8f-52fe-bbca-ff9100299fde with identifier: KC33777
2026-03-28 18:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4058d925-3f8f-52fe-bbca-ff9100299fde with identifier: KC33777 to the API
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KC33777>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:12:19Z',
 'fuel_type': 'diesel',
 'id': '4058d925-3f8f-52fe-bbca-ff9100299fde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC33777',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 107522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_8ed637fff088c11642d63eb6bf4c189d.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_512980fa0e357899e15e92085fcdaa2a.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_a22b649f4e696fe8a1b88d0e71df7fa4.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_43fa95a5989fda2a893b638b80c2d937.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_1aed6617c8ab0e369baaab851552a1bf.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_230dcc4f6da0355dbb9e7aeadee873be.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_1f8ad41c3e7265b5417370c891b6b6f5.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_22351ed825ec806dd45a60e6873ab070.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_4575425b21a3791ef3cf21eac6ea94a2.jpg',
                'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_9e6804a39c9903f9f3db72d9319dad2b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_8ed637fff088c11642d63eb6bf4c189d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_512980fa0e357899e15e92085fcdaa2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_a22b649f4e696fe8a1b88d0e71df7fa4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75274,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_43fa95a5989fda2a893b638b80c2d937.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_1aed6617c8ab0e369baaab851552a1bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71462,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_230dcc4f6da0355dbb9e7aeadee873be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_1f8ad41c3e7265b5417370c891b6b6f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_22351ed825ec806dd45a60e6873ab070.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_4575425b21a3791ef3cf21eac6ea94a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4058d925-3f8f-52fe-bbca-ff9100299fde/4058d925-3f8f-52fe-bbca-ff9100299fde_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/72/8472f8537004d04e5ff74ed4345b25c7/pa/KC33777_9e6804a39c9903f9f3db72d9319dad2b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC33777%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Saving data for KC33777: {'created_time': 1774723214.083164, 'last_price_update_time': 1774723214.083176, 'auction_closing_time': 1774883539.0}
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC33777') HTTP/1.1" 204 0
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_990e4d04a126a00e0de21a890d999f97.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_990e4d04a126a00e0de21a890d999f97.jpg not downloaded yet
2026-03-28 18:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_999eddf8151def617c4a406109104ed8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_39c5b229e0ffd63418169a748650e39c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for YN71631: 2
2026-03-28 18:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7128c69-799b-556a-b055-9e35aac7279e with identifier: YN71631
2026-03-28 18:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7128c69-799b-556a-b055-9e35aac7279e with scrape type 2
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7128c69-799b-556a-b055-9e35aac7279e with scrape type 2
2026-03-28 18:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7128c69-799b-556a-b055-9e35aac7279e, identifier: YN71631
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_9570602a9ca7b6b103f7e2fe95290abb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_9570602a9ca7b6b103f7e2fe95290abb.jpg not downloaded yet
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05a7d0>
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_1d9ac1c540fe2fdd419a0a621bcb32dc.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_1d9ac1c540fe2fdd419a0a621bcb32dc.jpg saved to cache
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4166df80-56af-5b93-9dbd-2fae34c82122
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c5650>
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_0516cb63de00b94b127a924d730a3f5f.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0516cb63de00b94b127a924d730a3f5f.jpg saved to cache
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b057850>
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_164deae6c1e47643267c716f8aca0788.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_164deae6c1e47643267c716f8aca0788.jpg saved to cache
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_28914bdc5126137dd5dffb2369654109.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7128c69-799b-556a-b055-9e35aac7279e with identifier: YN71631
2026-03-28 18:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7128c69-799b-556a-b055-9e35aac7279e with identifier: YN71631
2026-03-28 18:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7128c69-799b-556a-b055-9e35aac7279e with identifier: YN71631 to the API
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:40Z',
 'fuel_type': 'diesel',
 'id': 'f7128c69-799b-556a-b055-9e35aac7279e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN71631',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 163192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN71631%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Saving data for YN71631: {'auction_closing_time': 1774884760.0, 'created_time': 1774349947.094648, 'last_price_update_time': 1774723214.704042}
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YN71631') HTTP/1.1" 204 0
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_532f00b6eef5e5f47c8e1c36a33ef63f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_532f00b6eef5e5f47c8e1c36a33ef63f.jpg not downloaded yet
2026-03-28 18:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ09557> (referer: https://www.auto1.com/v1/car-details-view/XZ09557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP58071> (referer: https://www.auto1.com/v1/car-details-view/HP58071/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS08295> (referer: https://www.auto1.com/v1/car-details-view/VS08295/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY73105> (referer: https://www.auto1.com/v1/car-details-view/TY73105/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-28 18:40:14 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [auto1.de] INFO: Scrape type for EM86154: 2
2026-03-28 18:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c22d0e-d358-5971-b733-d291ee7957e1 with identifier: EM86154
2026-03-28 18:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c22d0e-d358-5971-b733-d291ee7957e1 with scrape type 2
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62c22d0e-d358-5971-b733-d291ee7957e1 with scrape type 2
2026-03-28 18:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62c22d0e-d358-5971-b733-d291ee7957e1, identifier: EM86154
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_21697a6d5712276a636119f514c208c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_21697a6d5712276a636119f514c208c3.jpg not downloaded yet
2026-03-28 18:40:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62c22d0e-d358-5971-b733-d291ee7957e1 with identifier: EM86154
2026-03-28 18:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62c22d0e-d358-5971-b733-d291ee7957e1 with identifier: EM86154
2026-03-28 18:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62c22d0e-d358-5971-b733-d291ee7957e1 with identifier: EM86154 to the API
2026-03-28 18:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:37Z',
 'fuel_type': 'diesel',
 'id': '62c22d0e-d358-5971-b733-d291ee7957e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM86154',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 117028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-09',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Style',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Style',
 'year': 2014}
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM86154%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [auto1.de] INFO: Saving data for EM86154: {'auction_closing_time': 1774886197.0, 'created_time': 1774118458.548449, 'last_price_update_time': 1774723215.192327}
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM86154') HTTP/1.1" 204 0
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_ce479bb6b3d4fec95f34c376acfbf0db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_ce479bb6b3d4fec95f34c376acfbf0db.jpg not downloaded yet
2026-03-28 18:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_00927cf20faf3208c6b22d19ccba2f2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:15 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-28 18:40:15 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [auto1.de] INFO: Scrape type for SK06184: 2
2026-03-28 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with identifier: SK06184
2026-03-28 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with scrape type 2
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with scrape type 2
2026-03-28 18:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26a95270-4439-5e1d-be6a-dab6dee4ecd1, identifier: SK06184
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_9b8abc26dca0ac0068fac4f8862315e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_9b8abc26dca0ac0068fac4f8862315e6.jpg not downloaded yet
2026-03-28 18:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_f155ae72d64b49a166f77524fd674878.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with identifier: SK06184
2026-03-28 18:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with identifier: SK06184
2026-03-28 18:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26a95270-4439-5e1d-be6a-dab6dee4ecd1 with identifier: SK06184 to the API
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:10:22Z',
 'fuel_type': 'petrol',
 'id': '26a95270-4439-5e1d-be6a-dab6dee4ecd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK06184',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 87906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK06184%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [auto1.de] INFO: Saving data for SK06184: {'auction_closing_time': 1774883422.0, 'created_time': 1774089213.168807, 'last_price_update_time': 1774723215.673741}
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK06184') HTTP/1.1" 204 0
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_aab8ecca9fc837fddce621e5e25192d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_aab8ecca9fc837fddce621e5e25192d2.jpg not downloaded yet
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc22250>
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_999eddf8151def617c4a406109104ed8.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_999eddf8151def617c4a406109104ed8.jpg saved to cache
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 72524a46-7194-594f-be70-a205886bb213
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf4790>
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_39c5b229e0ffd63418169a748650e39c.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_39c5b229e0ffd63418169a748650e39c.jpg saved to cache
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4166df80-56af-5b93-9dbd-2fae34c82122
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16c350>
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_28914bdc5126137dd5dffb2369654109.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_28914bdc5126137dd5dffb2369654109.jpg saved to cache
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with identifier: XZ09557
2026-03-28 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with scrape type 1
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_4b558a5948502c1f08583ca6a9b74b59.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_4b558a5948502c1f08583ca6a9b74b59.jpg not downloaded yet
2026-03-28 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1829cd-6828-5e48-bebc-97518a7631cc with identifier: HP58071
2026-03-28 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1829cd-6828-5e48-bebc-97518a7631cc with scrape type 1
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_60165dbe362142446d9e503b2a046a6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_60165dbe362142446d9e503b2a046a6e.jpg not downloaded yet
2026-03-28 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c2ce450-dfed-5463-a251-95873472a8f3 with identifier: VS08295
2026-03-28 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c2ce450-dfed-5463-a251-95873472a8f3 with scrape type 1
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1c2ce450-dfed-5463-a251-95873472a8f3
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_750fd70c9b8c86ea6291bed15e444d1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_750fd70c9b8c86ea6291bed15e444d1d.jpg not downloaded yet
2026-03-28 18:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e800b86e-86a9-52aa-9160-aac6078e6c6d with identifier: TY73105
2026-03-28 18:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e800b86e-86a9-52aa-9160-aac6078e6c6d with scrape type 1
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e800b86e-86a9-52aa-9160-aac6078e6c6d
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_9d9b54d0b1d36bff03a3463d09f30280.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_9d9b54d0b1d36bff03a3463d09f30280.jpg not downloaded yet
2026-03-28 18:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_7673fbd9975ea076721adaf4a14f4b7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:15 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-28 18:40:15 [auto1.de] INFO: Scrape type for SZ07968: 1
2026-03-28 18:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_51556c2c497d6966e36661c46a199288.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_51556c2c497d6966e36661c46a199288.jpg not downloaded yet
2026-03-28 18:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD05213> (referer: https://www.auto1.com/v1/car-details-view/ZD05213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_48de204ad446901d56bae2ea0a151211.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_48de204ad446901d56bae2ea0a151211.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_0fcb519652e81b7980aeb42d81ce4a86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_0fcb519652e81b7980aeb42d81ce4a86.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_baed010bb5438472c500f7491bbb7af3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_baed010bb5438472c500f7491bbb7af3.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_d34ea4a37107f33ff0639057ed066b05.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_d34ea4a37107f33ff0639057ed066b05.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_e87d6e6b9bdd249c3afc3863d91d4b45.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_e87d6e6b9bdd249c3afc3863d91d4b45.jpg not downloaded yet
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b104950>
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_00927cf20faf3208c6b22d19ccba2f2b.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_00927cf20faf3208c6b22d19ccba2f2b.jpg saved to cache
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4166df80-56af-5b93-9dbd-2fae34c82122
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for RT44513: 2
2026-03-28 18:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5012c90b-e10f-53cb-a3ff-213be3b99907 with identifier: RT44513
2026-03-28 18:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5012c90b-e10f-53cb-a3ff-213be3b99907 with scrape type 2
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5012c90b-e10f-53cb-a3ff-213be3b99907 with scrape type 2
2026-03-28 18:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5012c90b-e10f-53cb-a3ff-213be3b99907, identifier: RT44513
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_5e8df74ecb7f60127e689f413d9fda9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_5e8df74ecb7f60127e689f413d9fda9c.jpg not downloaded yet
2026-03-28 18:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_9570602a9ca7b6b103f7e2fe95290abb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_54193b08587f5eacf43674c2483601e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5012c90b-e10f-53cb-a3ff-213be3b99907 with identifier: RT44513
2026-03-28 18:40:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5012c90b-e10f-53cb-a3ff-213be3b99907 with identifier: RT44513
2026-03-28 18:40:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5012c90b-e10f-53cb-a3ff-213be3b99907 with identifier: RT44513 to the API
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:30:07Z',
 'fuel_type': 'petrol',
 'id': '5012c90b-e10f-53cb-a3ff-213be3b99907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT44513',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 128753,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.8 TSI GTI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTI BlueMotion Tech',
 'year': 2016}
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT44513%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Saving data for RT44513: {'auction_closing_time': 1774884607.0, 'created_time': 1774031920.098798, 'last_price_update_time': 1774723216.632062}
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT44513') HTTP/1.1" 204 0
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_4432b84d24f5d9d0b327f9dba4871634.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_4432b84d24f5d9d0b327f9dba4871634.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_349cb786c163cb67748f59f5d448f58a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_349cb786c163cb67748f59f5d448f58a.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_4d542ede1a48890372554ea9728d814e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_4d542ede1a48890372554ea9728d814e.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_901171fe1ab43002b20ec3af5762e811.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_901171fe1ab43002b20ec3af5762e811.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_ea98c529ff45e8d11e832c2bafc0a9ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ea98c529ff45e8d11e832c2bafc0a9ae.jpg not downloaded yet
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for JB74543: 1
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b162710>
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_f155ae72d64b49a166f77524fd674878.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_f155ae72d64b49a166f77524fd674878.jpg saved to cache
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4166df80-56af-5b93-9dbd-2fae34c82122
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc30bd0>
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_7673fbd9975ea076721adaf4a14f4b7b.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_7673fbd9975ea076721adaf4a14f4b7b.jpg saved to cache
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 72524a46-7194-594f-be70-a205886bb213
2026-03-28 18:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76f53c22-b752-544e-bb7f-49841a69b62b with identifier: ZD05213
2026-03-28 18:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f53c22-b752-544e-bb7f-49841a69b62b with scrape type 1
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 76f53c22-b752-544e-bb7f-49841a69b62b
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_8aa1f6f540d8eb220b3512249f835935.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_8aa1f6f540d8eb220b3512249f835935.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_236b0027332904c3707a97b37546c5b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_236b0027332904c3707a97b37546c5b1.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_9969d8e9f3bc36c82e66ea7ce91d330b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_9969d8e9f3bc36c82e66ea7ce91d330b.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_ccd7e677be340ab48416af7acefc2be5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_ccd7e677be340ab48416af7acefc2be5.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_4c6cabeaa44d2cc049b2fe61ff4a2b78.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_4c6cabeaa44d2cc049b2fe61ff4a2b78.jpg not downloaded yet
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_45e128309a2d3febb5c67e938ac7467a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_45e128309a2d3febb5c67e938ac7467a.jpg not downloaded yet
2026-03-28 18:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_990e4d04a126a00e0de21a890d999f97.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:16 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [auto1.de] INFO: Scrape type for HX73394: 1
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_fb896a01a81ee6d6a19887ea94428111.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_fb896a01a81ee6d6a19887ea94428111.jpg not downloaded yet
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_1fb280d1dce7e5f7e0a747a362b53a76.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_1fb280d1dce7e5f7e0a747a362b53a76.jpg not downloaded yet
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_2814bfcdfebed17ca3bd7be6b58ad56b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_2814bfcdfebed17ca3bd7be6b58ad56b.jpg not downloaded yet
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_df3449c2cf7f3d5e29429c4551153788.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_df3449c2cf7f3d5e29429c4551153788.jpg not downloaded yet
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_f847b3bc1d04f028faf2f38cd34181e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_f847b3bc1d04f028faf2f38cd34181e1.jpg not downloaded yet
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_ee8a79a64c2badf4462b3526c7d7909c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ee8a79a64c2badf4462b3526c7d7909c.jpg not downloaded yet
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd80450>
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_9570602a9ca7b6b103f7e2fe95290abb.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_9570602a9ca7b6b103f7e2fe95290abb.jpg saved to cache
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b023790>
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_54193b08587f5eacf43674c2483601e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_54193b08587f5eacf43674c2483601e9.jpg saved to cache
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_5e682ffca5441a10f3fc5c81c90fd7a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Scrape type for ES38254: 2
2026-03-28 18:40:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b170c2e8-9050-5572-aa7d-bc391fa23168 with identifier: ES38254
2026-03-28 18:40:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b170c2e8-9050-5572-aa7d-bc391fa23168 with scrape type 2
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b170c2e8-9050-5572-aa7d-bc391fa23168 with scrape type 2
2026-03-28 18:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b170c2e8-9050-5572-aa7d-bc391fa23168, identifier: ES38254
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_5e2a0bb35db2f3a28f5d8f8b1d1c5a73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_5e2a0bb35db2f3a28f5d8f8b1d1c5a73.jpg not downloaded yet
2026-03-28 18:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_817533a4254388513c88f55c163778bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b170c2e8-9050-5572-aa7d-bc391fa23168 with identifier: ES38254
2026-03-28 18:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b170c2e8-9050-5572-aa7d-bc391fa23168 with identifier: ES38254
2026-03-28 18:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b170c2e8-9050-5572-aa7d-bc391fa23168 with identifier: ES38254 to the API
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:43:36Z',
 'fuel_type': 'diesel',
 'id': 'b170c2e8-9050-5572-aa7d-bc391fa23168',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES38254',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 281239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-04',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Vision 4WD',
 'transmission': 'automatic',
 'trim': 'Vision 4WD',
 'year': 2011}
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES38254%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Saving data for ES38254: {'auction_closing_time': 1774885416.0, 'created_time': 1773467782.385786, 'last_price_update_time': 1774723217.652964}
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES38254') HTTP/1.1" 204 0
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_bac0bf6435e10ecc6ee3852a82f77da1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_bac0bf6435e10ecc6ee3852a82f77da1.jpg not downloaded yet
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_d7ee2c9dc7788d73ee103c53bf0c1de0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_d7ee2c9dc7788d73ee103c53bf0c1de0.jpg not downloaded yet
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_16a3700a1c1c262b80676f7ef4bb955e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_16a3700a1c1c262b80676f7ef4bb955e.jpg not downloaded yet
2026-03-28 18:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_ce479bb6b3d4fec95f34c376acfbf0db.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Scrape type for PU69799: 1
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_f6ae14fce26da6d468e72f31cbf35915.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_f6ae14fce26da6d468e72f31cbf35915.jpg not downloaded yet
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2acc90>
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_990e4d04a126a00e0de21a890d999f97.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_990e4d04a126a00e0de21a890d999f97.jpg saved to cache
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_c125beacd88a8cff3422f10ab5bbf9cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_c125beacd88a8cff3422f10ab5bbf9cf.jpg not downloaded yet
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_1f38452504a559c234ba61ecaac65c43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_1f38452504a559c234ba61ecaac65c43.jpg not downloaded yet
2026-03-28 18:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_21697a6d5712276a636119f514c208c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:17 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [auto1.de] INFO: Scrape type for BM68891: 1
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_c7f80a5d03b8d33e7dc76a5b4ecaec14.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_c7f80a5d03b8d33e7dc76a5b4ecaec14.jpg not downloaded yet
2026-03-28 18:40:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR23306/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc31e10>
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_5e682ffca5441a10f3fc5c81c90fd7a3.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_5e682ffca5441a10f3fc5c81c90fd7a3.jpg saved to cache
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1a9690>
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_817533a4254388513c88f55c163778bb.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_817533a4254388513c88f55c163778bb.jpg saved to cache
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4166df80-56af-5b93-9dbd-2fae34c82122
2026-03-28 18:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_750fd70c9b8c86ea6291bed15e444d1d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_9d9b54d0b1d36bff03a3463d09f30280.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_b4bde1455428a37cd4785490b4c4e8f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_b4bde1455428a37cd4785490b4c4e8f4.jpg not downloaded yet
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_d3d4877e3a939f6d3530e4ec205a63df.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_d3d4877e3a939f6d3530e4ec205a63df.jpg not downloaded yet
2026-03-28 18:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for AN35443: 2
2026-03-28 18:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with identifier: AN35443
2026-03-28 18:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with scrape type 2
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with scrape type 2
2026-03-28 18:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c, identifier: AN35443
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_3cd01f3adaa4b81a31ec5b8e4dff55a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_3cd01f3adaa4b81a31ec5b8e4dff55a2.jpg not downloaded yet
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb658d0>
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_ce479bb6b3d4fec95f34c376acfbf0db.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_ce479bb6b3d4fec95f34c376acfbf0db.jpg saved to cache
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_5e8df74ecb7f60127e689f413d9fda9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with identifier: AN35443
2026-03-28 18:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with identifier: AN35443
2026-03-28 18:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1410e6a-f26f-5e32-8e29-680ee9ec5e7c with identifier: AN35443 to the API
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:29:20Z',
 'fuel_type': 'petrol',
 'id': 'c1410e6a-f26f-5e32-8e29-680ee9ec5e7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN35443',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 74784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-14',
 'seller_name': None,
 'title': 'Hyundai ix35 2.0 GDI Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2014}
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN35443%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Saving data for AN35443: {'auction_closing_time': 1774884560.0, 'created_time': 1773466610.282873, 'last_price_update_time': 1774723218.676281}
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN35443') HTTP/1.1" 204 0
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_d76b9f06b1e2bc9b92ff4fe797b6cc71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_d76b9f06b1e2bc9b92ff4fe797b6cc71.jpg not downloaded yet
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_427b7db00e065d18fd2c29590e0e4f47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_427b7db00e065d18fd2c29590e0e4f47.jpg not downloaded yet
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7c890>
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_21697a6d5712276a636119f514c208c3.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_21697a6d5712276a636119f514c208c3.jpg saved to cache
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_c199e32d900bc32ee04d52a1c1edac03.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_45e128309a2d3febb5c67e938ac7467a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-28 18:40:18 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-28 18:40:18 [auto1.de] INFO: Scrape type for CP64572: 2
2026-03-28 18:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with identifier: CP64572
2026-03-28 18:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with scrape type 2
2026-03-28 18:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with scrape type 2
2026-03-28 18:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9fca7d07-84c8-5dd8-841b-8453e71f0f00, identifier: CP64572
2026-03-28 18:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_e87d6e6b9bdd249c3afc3863d91d4b45.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with identifier: CP64572
2026-03-28 18:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with identifier: CP64572
2026-03-28 18:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9fca7d07-84c8-5dd8-841b-8453e71f0f00 with identifier: CP64572 to the API
2026-03-28 18:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:51:02Z',
 'fuel_type': 'diesel',
 'id': '9fca7d07-84c8-5dd8-841b-8453e71f0f00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP64572',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 146720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP64572%27 HTTP/1.1" 200 None
2026-03-28 18:40:19 [auto1.de] INFO: Saving data for CP64572: {'auction_closing_time': 1774885862.0, 'created_time': 1774034372.274482, 'last_price_update_time': 1774723219.207778}
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP64572') HTTP/1.1" 204 0
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_28faf0472b4be86b42ce286a7407fdc6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_28faf0472b4be86b42ce286a7407fdc6.jpg not downloaded yet
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_b1b2f3148d906375e7046336ea1b5101.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_b1b2f3148d906375e7046336ea1b5101.jpg not downloaded yet
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda0b10>
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_750fd70c9b8c86ea6291bed15e444d1d.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_750fd70c9b8c86ea6291bed15e444d1d.jpg saved to cache
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c2ce450-dfed-5463-a251-95873472a8f3
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be80610>
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_9d9b54d0b1d36bff03a3463d09f30280.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_9d9b54d0b1d36bff03a3463d09f30280.jpg saved to cache
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e800b86e-86a9-52aa-9160-aac6078e6c6d
2026-03-28 18:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_629b50d8a40ae575c2f87f7b1a9f772d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:19 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-28 18:40:19 [auto1.de] INFO: Scrape type for CA31284: 1
2026-03-28 18:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_fb896a01a81ee6d6a19887ea94428111.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb3850>
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_5e8df74ecb7f60127e689f413d9fda9c.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_5e8df74ecb7f60127e689f413d9fda9c.jpg saved to cache
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b193a90>
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_c199e32d900bc32ee04d52a1c1edac03.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_c199e32d900bc32ee04d52a1c1edac03.jpg saved to cache
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbaae10>
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_45e128309a2d3febb5c67e938ac7467a.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_45e128309a2d3febb5c67e938ac7467a.jpg saved to cache
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e800b86e-86a9-52aa-9160-aac6078e6c6d
2026-03-28 18:40:19 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-28 18:40:19 [auto1.de] INFO: Scrape type for JE64211: 2
2026-03-28 18:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f60918-6a4c-5cf8-8279-b37853096524 with identifier: JE64211
2026-03-28 18:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f60918-6a4c-5cf8-8279-b37853096524 with scrape type 2
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1f60918-6a4c-5cf8-8279-b37853096524 with scrape type 2
2026-03-28 18:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1f60918-6a4c-5cf8-8279-b37853096524, identifier: JE64211
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcf1ed0>
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_e87d6e6b9bdd249c3afc3863d91d4b45.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_e87d6e6b9bdd249c3afc3863d91d4b45.jpg saved to cache
2026-03-28 18:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e800b86e-86a9-52aa-9160-aac6078e6c6d
2026-03-28 18:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1f60918-6a4c-5cf8-8279-b37853096524 with identifier: JE64211
2026-03-28 18:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1f60918-6a4c-5cf8-8279-b37853096524 with identifier: JE64211
2026-03-28 18:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1f60918-6a4c-5cf8-8279-b37853096524 with identifier: JE64211 to the API
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:53:17Z',
 'fuel_type': 'diesel',
 'id': 'd1f60918-6a4c-5cf8-8279-b37853096524',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE64211',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 256562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-05',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2015}
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE64211%27 HTTP/1.1" 200 None
2026-03-28 18:40:20 [auto1.de] INFO: Saving data for JE64211: {'auction_closing_time': 1774885997.0, 'created_time': 1773400637.376709, 'last_price_update_time': 1774723220.066138}
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE64211') HTTP/1.1" 204 0
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_f6ae14fce26da6d468e72f31cbf35915.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_5e2a0bb35db2f3a28f5d8f8b1d1c5a73.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ee8a79a64c2badf4462b3526c7d7909c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_1f38452504a559c234ba61ecaac65c43.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-28 18:40:20 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-28 18:40:20 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-28 18:40:20 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-28 18:40:20 [auto1.de] INFO: Scrape type for RU51924: 2
2026-03-28 18:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bddfc405-b46d-575c-8a36-feebeed8d7c0 with identifier: RU51924
2026-03-28 18:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bddfc405-b46d-575c-8a36-feebeed8d7c0 with scrape type 2
2026-03-28 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bddfc405-b46d-575c-8a36-feebeed8d7c0 with scrape type 2
2026-03-28 18:40:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bddfc405-b46d-575c-8a36-feebeed8d7c0, identifier: RU51924
2026-03-28 18:40:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcc05d0>
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_629b50d8a40ae575c2f87f7b1a9f772d.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_629b50d8a40ae575c2f87f7b1a9f772d.jpg saved to cache
2026-03-28 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb60690>
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_fb896a01a81ee6d6a19887ea94428111.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_fb896a01a81ee6d6a19887ea94428111.jpg saved to cache
2026-03-28 18:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76f53c22-b752-544e-bb7f-49841a69b62b
2026-03-28 18:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_64bc871bfd75f5a3df14769dacd45055.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_c125beacd88a8cff3422f10ab5bbf9cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bddfc405-b46d-575c-8a36-feebeed8d7c0 with identifier: RU51924
2026-03-28 18:40:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bddfc405-b46d-575c-8a36-feebeed8d7c0 with identifier: RU51924
2026-03-28 18:40:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bddfc405-b46d-575c-8a36-feebeed8d7c0 with identifier: RU51924 to the API
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:03:49Z',
 'fuel_type': 'hybrid',
 'id': 'bddfc405-b46d-575c-8a36-feebeed8d7c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU51924',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 73632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-19',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV First Edition',
 'transmission': 'automatic',
 'trim': 'First Edition',
 'year': 2020}
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51924%27 HTTP/1.1" 200 None
2026-03-28 18:40:20 [auto1.de] INFO: Saving data for RU51924: {'auction_closing_time': 1774883029.0, 'created_time': 1773427147.953351, 'last_price_update_time': 1774723220.741114}
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU51924') HTTP/1.1" 204 0
2026-03-28 18:40:20 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-28 18:40:20 [auto1.de] INFO: Scrape type for UM98970: 1
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_3cd01f3adaa4b81a31ec5b8e4dff55a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_427b7db00e065d18fd2c29590e0e4f47.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_d3d4877e3a939f6d3530e4ec205a63df.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:20 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-28 18:40:20 [auto1.de] INFO: Scrape type for PP81333: 1
2026-03-28 18:40:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c2e90>
2026-03-28 18:40:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_f6ae14fce26da6d468e72f31cbf35915.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_f6ae14fce26da6d468e72f31cbf35915.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76f53c22-b752-544e-bb7f-49841a69b62b
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2aa510>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_5e2a0bb35db2f3a28f5d8f8b1d1c5a73.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_5e2a0bb35db2f3a28f5d8f8b1d1c5a73.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76f53c22-b752-544e-bb7f-49841a69b62b
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beadb10>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_ee8a79a64c2badf4462b3526c7d7909c.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ee8a79a64c2badf4462b3526c7d7909c.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e800b86e-86a9-52aa-9160-aac6078e6c6d
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a9c2c90>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_1f38452504a559c234ba61ecaac65c43.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_1f38452504a559c234ba61ecaac65c43.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcf2650>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_64bc871bfd75f5a3df14769dacd45055.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_64bc871bfd75f5a3df14769dacd45055.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb9c10>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_c125beacd88a8cff3422f10ab5bbf9cf.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_c125beacd88a8cff3422f10ab5bbf9cf.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-28 18:40:21 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_28faf0472b4be86b42ce286a7407fdc6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_b1b2f3148d906375e7046336ea1b5101.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU69799/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1ca5d0>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_3cd01f3adaa4b81a31ec5b8e4dff55a2.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_3cd01f3adaa4b81a31ec5b8e4dff55a2.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76f53c22-b752-544e-bb7f-49841a69b62b
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beff9d0>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_427b7db00e065d18fd2c29590e0e4f47.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_427b7db00e065d18fd2c29590e0e4f47.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6cb90>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_d3d4877e3a939f6d3530e4ec205a63df.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_d3d4877e3a939f6d3530e4ec205a63df.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_cf3a9c5725ad398635ae409722de8769.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_c7f80a5d03b8d33e7dc76a5b4ecaec14.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd5b410>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_28faf0472b4be86b42ce286a7407fdc6.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_28faf0472b4be86b42ce286a7407fdc6.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b22d550>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_b1b2f3148d906375e7046336ea1b5101.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_b1b2f3148d906375e7046336ea1b5101.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_c7b9b69c1ae32ab047de4bc621e6b00f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd7a710>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_cf3a9c5725ad398635ae409722de8769.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_cf3a9c5725ad398635ae409722de8769.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_16a3700a1c1c262b80676f7ef4bb955e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_f847b3bc1d04f028faf2f38cd34181e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_d7ee2c9dc7788d73ee103c53bf0c1de0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb5d950>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_c7f80a5d03b8d33e7dc76a5b4ecaec14.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_c7f80a5d03b8d33e7dc76a5b4ecaec14.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76f53c22-b752-544e-bb7f-49841a69b62b
2026-03-28 18:40:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7c250>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_c7b9b69c1ae32ab047de4bc621e6b00f.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_c7b9b69c1ae32ab047de4bc621e6b00f.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_d76b9f06b1e2bc9b92ff4fe797b6cc71.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_df3449c2cf7f3d5e29429c4551153788.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_1fb280d1dce7e5f7e0a747a362b53a76.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2ec490>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_16a3700a1c1c262b80676f7ef4bb955e.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_16a3700a1c1c262b80676f7ef4bb955e.jpg saved to cache
2026-03-28 18:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc162d0>
2026-03-28 18:40:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_f847b3bc1d04f028faf2f38cd34181e1.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_f847b3bc1d04f028faf2f38cd34181e1.jpg saved to cache
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c2ce450-dfed-5463-a251-95873472a8f3
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb5f250>
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_d7ee2c9dc7788d73ee103c53bf0c1de0.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_d7ee2c9dc7788d73ee103c53bf0c1de0.jpg saved to cache
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_4c6cabeaa44d2cc049b2fe61ff4a2b78.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM68891/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR23306> (referer: https://www.auto1.com/v1/car-details-view/JR23306/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc5f290>
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_d76b9f06b1e2bc9b92ff4fe797b6cc71.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_d76b9f06b1e2bc9b92ff4fe797b6cc71.jpg saved to cache
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb57950>
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_df3449c2cf7f3d5e29429c4551153788.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_df3449c2cf7f3d5e29429c4551153788.jpg saved to cache
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbec650>
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_1fb280d1dce7e5f7e0a747a362b53a76.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_1fb280d1dce7e5f7e0a747a362b53a76.jpg saved to cache
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_ccd7e677be340ab48416af7acefc2be5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_b4bde1455428a37cd4785490b4c4e8f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_8aa1f6f540d8eb220b3512249f835935.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA31284/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb57310>
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_4c6cabeaa44d2cc049b2fe61ff4a2b78.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_4c6cabeaa44d2cc049b2fe61ff4a2b78.jpg saved to cache
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c2ce450-dfed-5463-a251-95873472a8f3
2026-03-28 18:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f166f91-aded-5f14-95b0-f1568ac05574 with identifier: JR23306
2026-03-28 18:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f166f91-aded-5f14-95b0-f1568ac05574 with scrape type 1
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 1f166f91-aded-5f14-95b0-f1568ac05574
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F21%252Fc72129209acca304a4393ff51efce1cd%252Fpa%252FJR23306_0ddaf732b32aeb6fb2272b1539522dbd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_0ddaf732b32aeb6fb2272b1539522dbd.jpg already downloaded
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F21%252Fc72129209acca304a4393ff51efce1cd%252Fpa%252FJR23306_5f1b6d9c7919d1826280e750753a53cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_5f1b6d9c7919d1826280e750753a53cc.jpg already downloaded
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F21%252Fc72129209acca304a4393ff51efce1cd%252Fpa%252FJR23306_55cd620b0613565cee9c4a751f4252f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_55cd620b0613565cee9c4a751f4252f4.jpg already downloaded
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F21%252Fc72129209acca304a4393ff51efce1cd%252Fpa%252FJR23306_b19d4889b4f79f3d6af7b3229c767791.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_b19d4889b4f79f3d6af7b3229c767791.jpg already downloaded
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F21%252Fc72129209acca304a4393ff51efce1cd%252Fpa%252FJR23306_c93baf871fbd3a92c8ed0166b50828b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_c93baf871fbd3a92c8ed0166b50828b5.jpg already downloaded
2026-03-28 18:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f166f91-aded-5f14-95b0-f1568ac05574, identifier: JR23306
2026-03-28 18:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f166f91-aded-5f14-95b0-f1568ac05574 with identifier: JR23306
2026-03-28 18:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f166f91-aded-5f14-95b0-f1568ac05574 with identifier: JR23306
2026-03-28 18:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f166f91-aded-5f14-95b0-f1568ac05574 with identifier: JR23306 to the API
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR23306>
{'auction_title': '',
 'c_o_2_emission_value': 203,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.8L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:34Z',
 'fuel_type': 'petrol',
 'id': '1f166f91-aded-5f14-95b0-f1568ac05574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR23306',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 315776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_0ddaf732b32aeb6fb2272b1539522dbd.jpg',
                'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_5f1b6d9c7919d1826280e750753a53cc.jpg',
                'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_55cd620b0613565cee9c4a751f4252f4.jpg',
                'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_b19d4889b4f79f3d6af7b3229c767791.jpg',
                'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_c93baf871fbd3a92c8ed0166b50828b5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f166f91-aded-5f14-95b0-f1568ac05574/1f166f91-aded-5f14-95b0-f1568ac05574_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 121828,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_0ddaf732b32aeb6fb2272b1539522dbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f166f91-aded-5f14-95b0-f1568ac05574/1f166f91-aded-5f14-95b0-f1568ac05574_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105510,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_5f1b6d9c7919d1826280e750753a53cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f166f91-aded-5f14-95b0-f1568ac05574/1f166f91-aded-5f14-95b0-f1568ac05574_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_55cd620b0613565cee9c4a751f4252f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f166f91-aded-5f14-95b0-f1568ac05574/1f166f91-aded-5f14-95b0-f1568ac05574_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_b19d4889b4f79f3d6af7b3229c767791.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f166f91-aded-5f14-95b0-f1568ac05574/1f166f91-aded-5f14-95b0-f1568ac05574_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/21/c72129209acca304a4393ff51efce1cd/pa/JR23306_c93baf871fbd3a92c8ed0166b50828b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1998-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 Turbo Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 1998}
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR23306%27 HTTP/1.1" 200 None
2026-03-28 18:40:23 [auto1.de] INFO: Saving data for JR23306: {'created_time': 1774723223.053502, 'last_price_update_time': 1774723223.053519, 'auction_closing_time': 1774886194.0}
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR23306') HTTP/1.1" 204 0
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_236b0027332904c3707a97b37546c5b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM98970/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP81333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_901171fe1ab43002b20ec3af5762e811.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_4d542ede1a48890372554ea9728d814e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ea98c529ff45e8d11e832c2bafc0a9ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_349cb786c163cb67748f59f5d448f58a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HX73394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU69799> (referer: https://www.auto1.com/v1/car-details-view/PU69799/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd59ad0>
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_ccd7e677be340ab48416af7acefc2be5.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_ccd7e677be340ab48416af7acefc2be5.jpg saved to cache
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b18d690>
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_b4bde1455428a37cd4785490b4c4e8f4.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_b4bde1455428a37cd4785490b4c4e8f4.jpg saved to cache
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b28b5d0>
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg60%252F18%252F60187cd7cfd2c18e7834069f62ff4dfb%252Fpa%252FZD05213_8aa1f6f540d8eb220b3512249f835935.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_8aa1f6f540d8eb220b3512249f835935.jpg saved to cache
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76f53c22-b752-544e-bb7f-49841a69b62b
2026-03-28 18:40:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76f53c22-b752-544e-bb7f-49841a69b62b, skipping ID generation
2026-03-28 18:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76f53c22-b752-544e-bb7f-49841a69b62b with scrape type 1
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76f53c22-b752-544e-bb7f-49841a69b62b sending to next pipeline
2026-03-28 18:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76f53c22-b752-544e-bb7f-49841a69b62b, identifier: ZD05213
2026-03-28 18:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76f53c22-b752-544e-bb7f-49841a69b62b with identifier: ZD05213
2026-03-28 18:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76f53c22-b752-544e-bb7f-49841a69b62b with identifier: ZD05213
2026-03-28 18:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76f53c22-b752-544e-bb7f-49841a69b62b with identifier: ZD05213 to the API
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_8aa1f6f540d8eb220b3512249f835935.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.9L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:32:54Z',
 'fuel_type': 'diesel',
 'id': '76f53c22-b752-544e-bb7f-49841a69b62b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD05213',
 'listing': 'auction',
 'location': 'DE, Kumhausen',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 174351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_8aa1f6f540d8eb220b3512249f835935.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_fb896a01a81ee6d6a19887ea94428111.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_5e2a0bb35db2f3a28f5d8f8b1d1c5a73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_f6ae14fce26da6d468e72f31cbf35915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81608,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_c7f80a5d03b8d33e7dc76a5b4ecaec14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76f53c22-b752-544e-bb7f-49841a69b62b/76f53c22-b752-544e-bb7f-49841a69b62b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img60/18/60187cd7cfd2c18e7834069f62ff4dfb/pa/ZD05213_3cd01f3adaa4b81a31ec5b8e4dff55a2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-08-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Goal',
 'transmission': 'automatic',
 'trim': 'Goal',
 'year': 2006}
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD05213%27 HTTP/1.1" 200 None
2026-03-28 18:40:23 [auto1.de] INFO: Saving data for ZD05213: {'created_time': 1774723223.757099, 'last_price_update_time': 1774723223.757112, 'auction_closing_time': 1774884774.0}
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD05213') HTTP/1.1" 204 0
2026-03-28 18:40:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_4432b84d24f5d9d0b327f9dba4871634.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb92ad0>
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_236b0027332904c3707a97b37546c5b1.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_236b0027332904c3707a97b37546c5b1.jpg saved to cache
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc03b10>
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_901171fe1ab43002b20ec3af5762e811.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_901171fe1ab43002b20ec3af5762e811.jpg saved to cache
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c2ce450-dfed-5463-a251-95873472a8f3
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1d7250>
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_4d542ede1a48890372554ea9728d814e.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_4d542ede1a48890372554ea9728d814e.jpg saved to cache
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbcfdd0>
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Ff7%252F1ef7037202b6b01869fd8b8fbb7c0f07%252Fpa%252FTY73105_ea98c529ff45e8d11e832c2bafc0a9ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ea98c529ff45e8d11e832c2bafc0a9ae.jpg saved to cache
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e800b86e-86a9-52aa-9160-aac6078e6c6d
2026-03-28 18:40:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e800b86e-86a9-52aa-9160-aac6078e6c6d, skipping ID generation
2026-03-28 18:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e800b86e-86a9-52aa-9160-aac6078e6c6d with scrape type 1
2026-03-28 18:40:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e800b86e-86a9-52aa-9160-aac6078e6c6d sending to next pipeline
2026-03-28 18:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e800b86e-86a9-52aa-9160-aac6078e6c6d, identifier: TY73105
2026-03-28 18:40:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf4b10>
2026-03-28 18:40:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_349cb786c163cb67748f59f5d448f58a.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_349cb786c163cb67748f59f5d448f58a.jpg saved to cache
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e080d537-bfc3-5ed6-897c-09a66c99f7ae with identifier: PU69799
2026-03-28 18:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e080d537-bfc3-5ed6-897c-09a66c99f7ae with scrape type 1
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e080d537-bfc3-5ed6-897c-09a66c99f7ae
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_733a7b635737ac65721c4c9a6d53f370.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_733a7b635737ac65721c4c9a6d53f370.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_600f4d72b56aed23de8cc08ef0125023.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_600f4d72b56aed23de8cc08ef0125023.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_294783c84f3c10e7d82a7901824dc607.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_294783c84f3c10e7d82a7901824dc607.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_e011e41716890252005b61d658ca35a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_e011e41716890252005b61d658ca35a5.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_ce31af85cb3ff3c7e138b1b4b25d52aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_ce31af85cb3ff3c7e138b1b4b25d52aa.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_d1371b53bee52eb55730c3aa30bd6415.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_d1371b53bee52eb55730c3aa30bd6415.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_abb1f1b38fd9d0d549878d0c08c459e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_abb1f1b38fd9d0d549878d0c08c459e2.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_81144d1bfbdf1e7c0841475ed3a66067.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_81144d1bfbdf1e7c0841475ed3a66067.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_97847a56e24e649201defcca9d8dec0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_97847a56e24e649201defcca9d8dec0b.jpg already downloaded
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbe%252F0d%252Fbe0dc739ba815d32e49d36b01f9152a2%252Fpa%252FPU69799_5cded9f4d1451ef91e2a417192340f6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_5cded9f4d1451ef91e2a417192340f6b.jpg already downloaded
2026-03-28 18:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e080d537-bfc3-5ed6-897c-09a66c99f7ae, identifier: PU69799
2026-03-28 18:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_d34ea4a37107f33ff0639057ed066b05.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e800b86e-86a9-52aa-9160-aac6078e6c6d with identifier: TY73105
2026-03-28 18:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e800b86e-86a9-52aa-9160-aac6078e6c6d with identifier: TY73105
2026-03-28 18:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e800b86e-86a9-52aa-9160-aac6078e6c6d with identifier: TY73105 to the API
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ea98c529ff45e8d11e832c2bafc0a9ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:43:15Z',
 'fuel_type': 'diesel',
 'id': 'e800b86e-86a9-52aa-9160-aac6078e6c6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY73105',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'Volkswagen',
 'model': 'T4 Transporter',
 'odometer': 162087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_9d9b54d0b1d36bff03a3463d09f30280.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_e87d6e6b9bdd249c3afc3863d91d4b45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ea98c529ff45e8d11e832c2bafc0a9ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59936,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_45e128309a2d3febb5c67e938ac7467a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e800b86e-86a9-52aa-9160-aac6078e6c6d/e800b86e-86a9-52aa-9160-aac6078e6c6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/f7/1ef7037202b6b01869fd8b8fbb7c0f07/pa/TY73105_ee8a79a64c2badf4462b3526c7d7909c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1999-09-21',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen T4 Transporter 2.4 SD Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 1999}
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY73105%27 HTTP/1.1" 200 None
2026-03-28 18:40:24 [auto1.de] INFO: Saving data for TY73105: {'created_time': 1774723224.721703, 'last_price_update_time': 1774723224.721719, 'auction_closing_time': 1774885395.0}
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY73105') HTTP/1.1" 204 0
2026-03-28 18:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e080d537-bfc3-5ed6-897c-09a66c99f7ae with identifier: PU69799
2026-03-28 18:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e080d537-bfc3-5ed6-897c-09a66c99f7ae with identifier: PU69799
2026-03-28 18:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e080d537-bfc3-5ed6-897c-09a66c99f7ae with identifier: PU69799 to the API
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PU69799>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:51:14Z',
 'fuel_type': 'petrol',
 'id': 'e080d537-bfc3-5ed6-897c-09a66c99f7ae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU69799',
 'listing': 'auction',
 'location': 'DE, Sulz am Neckar',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 30094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_733a7b635737ac65721c4c9a6d53f370.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_600f4d72b56aed23de8cc08ef0125023.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_294783c84f3c10e7d82a7901824dc607.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_e011e41716890252005b61d658ca35a5.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_ce31af85cb3ff3c7e138b1b4b25d52aa.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_d1371b53bee52eb55730c3aa30bd6415.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_abb1f1b38fd9d0d549878d0c08c459e2.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_81144d1bfbdf1e7c0841475ed3a66067.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_97847a56e24e649201defcca9d8dec0b.jpg',
                'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_5cded9f4d1451ef91e2a417192340f6b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_733a7b635737ac65721c4c9a6d53f370.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_600f4d72b56aed23de8cc08ef0125023.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2003949,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_294783c84f3c10e7d82a7901824dc607.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_e011e41716890252005b61d658ca35a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1991801,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_ce31af85cb3ff3c7e138b1b4b25d52aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_d1371b53bee52eb55730c3aa30bd6415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_abb1f1b38fd9d0d549878d0c08c459e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_81144d1bfbdf1e7c0841475ed3a66067.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2193341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_97847a56e24e649201defcca9d8dec0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e080d537-bfc3-5ed6-897c-09a66c99f7ae/e080d537-bfc3-5ed6-897c-09a66c99f7ae_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbe/0d/be0dc739ba815d32e49d36b01f9152a2/pa/PU69799_5cded9f4d1451ef91e2a417192340f6b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-10-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU69799%27 HTTP/1.1" 200 None
2026-03-28 18:40:25 [auto1.de] INFO: Saving data for PU69799: {'created_time': 1774723225.063268, 'last_price_update_time': 1774723225.06328, 'auction_closing_time': 1774885874.0}
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU69799') HTTP/1.1" 204 0
2026-03-28 18:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_baed010bb5438472c500f7491bbb7af3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_48de204ad446901d56bae2ea0a151211.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB74543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_51556c2c497d6966e36661c46a199288.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0726d0>
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_4432b84d24f5d9d0b327f9dba4871634.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_4432b84d24f5d9d0b327f9dba4871634.jpg saved to cache
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16ff50>
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F60%252Fe8600f02543fed1f056bbfb42d92184b%252Fpa%252FVS08295_d34ea4a37107f33ff0639057ed066b05.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_d34ea4a37107f33ff0639057ed066b05.jpg saved to cache
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c2ce450-dfed-5463-a251-95873472a8f3
2026-03-28 18:40:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c2ce450-dfed-5463-a251-95873472a8f3, skipping ID generation
2026-03-28 18:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c2ce450-dfed-5463-a251-95873472a8f3 with scrape type 1
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c2ce450-dfed-5463-a251-95873472a8f3 sending to next pipeline
2026-03-28 18:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c2ce450-dfed-5463-a251-95873472a8f3, identifier: VS08295
2026-03-28 18:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c2ce450-dfed-5463-a251-95873472a8f3 with identifier: VS08295
2026-03-28 18:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c2ce450-dfed-5463-a251-95873472a8f3 with identifier: VS08295
2026-03-28 18:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c2ce450-dfed-5463-a251-95873472a8f3 with identifier: VS08295 to the API
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_d34ea4a37107f33ff0639057ed066b05.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine': '2.5L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:13:39Z',
 'fuel_type': 'petrol',
 'id': '1c2ce450-dfed-5463-a251-95873472a8f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS08295',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'BMW',
 'model': '5er',
 'odometer': 186486,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_750fd70c9b8c86ea6291bed15e444d1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_d34ea4a37107f33ff0639057ed066b05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_901171fe1ab43002b20ec3af5762e811.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94134,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_4c6cabeaa44d2cc049b2fe61ff4a2b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1c2ce450-dfed-5463-a251-95873472a8f3/1c2ce450-dfed-5463-a251-95873472a8f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/60/e8600f02543fed1f056bbfb42d92184b/pa/VS08295_f847b3bc1d04f028faf2f38cd34181e1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS08295%27 HTTP/1.1" 200 None
2026-03-28 18:40:25 [auto1.de] INFO: Saving data for VS08295: {'created_time': 1774723225.638912, 'last_price_update_time': 1774723225.638925, 'auction_closing_time': 1774883619.0}
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS08295') HTTP/1.1" 204 0
2026-03-28 18:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_aab8ecca9fc837fddce621e5e25192d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_60165dbe362142446d9e503b2a046a6e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b297b50>
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_baed010bb5438472c500f7491bbb7af3.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_baed010bb5438472c500f7491bbb7af3.jpg saved to cache
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb4dd0>
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_48de204ad446901d56bae2ea0a151211.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_48de204ad446901d56bae2ea0a151211.jpg saved to cache
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10a710>
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_51556c2c497d6966e36661c46a199288.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_51556c2c497d6966e36661c46a199288.jpg saved to cache
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_9b8abc26dca0ac0068fac4f8862315e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0e090>
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_aab8ecca9fc837fddce621e5e25192d2.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_aab8ecca9fc837fddce621e5e25192d2.jpg saved to cache
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16d110>
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252Faf%252F65afec0fb995fa63c716cf445090ff9d%252Fpa%252FHP58071_60165dbe362142446d9e503b2a046a6e.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_60165dbe362142446d9e503b2a046a6e.jpg saved to cache
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a1829cd-6828-5e48-bebc-97518a7631cc
2026-03-28 18:40:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a1829cd-6828-5e48-bebc-97518a7631cc, skipping ID generation
2026-03-28 18:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1829cd-6828-5e48-bebc-97518a7631cc with scrape type 1
2026-03-28 18:40:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a1829cd-6828-5e48-bebc-97518a7631cc sending to next pipeline
2026-03-28 18:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a1829cd-6828-5e48-bebc-97518a7631cc, identifier: HP58071
2026-03-28 18:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a1829cd-6828-5e48-bebc-97518a7631cc with identifier: HP58071
2026-03-28 18:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a1829cd-6828-5e48-bebc-97518a7631cc with identifier: HP58071
2026-03-28 18:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a1829cd-6828-5e48-bebc-97518a7631cc with identifier: HP58071 to the API
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_60165dbe362142446d9e503b2a046a6e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 197,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:15:28Z',
 'fuel_type': 'diesel',
 'id': '9a1829cd-6828-5e48-bebc-97518a7631cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP58071',
 'listing': 'auction',
 'location': 'DE, Aachen',
 'make': 'Volkswagen',
 'model': 'Amarok',
 'odometer': 170824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89245,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_60165dbe362142446d9e503b2a046a6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_baed010bb5438472c500f7491bbb7af3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79063,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_4d542ede1a48890372554ea9728d814e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_ccd7e677be340ab48416af7acefc2be5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_df3449c2cf7f3d5e29429c4551153788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_16a3700a1c1c262b80676f7ef4bb955e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_1f38452504a559c234ba61ecaac65c43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_d3d4877e3a939f6d3530e4ec205a63df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_427b7db00e065d18fd2c29590e0e4f47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a1829cd-6828-5e48-bebc-97518a7631cc/9a1829cd-6828-5e48-bebc-97518a7631cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/af/65afec0fb995fa63c716cf445090ff9d/pa/HP58071_b1b2f3148d906375e7046336ea1b5101.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-05-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Amarok 2.0 TDI Highline DoubleCab 4Motion',
 'transmission': 'manual',
 'trim': 'Highline DoubleCab 4Motion',
 'year': 2013}
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP58071%27 HTTP/1.1" 200 None
2026-03-28 18:40:26 [auto1.de] INFO: Saving data for HP58071: {'created_time': 1774723226.425563, 'last_price_update_time': 1774723226.425573, 'auction_closing_time': 1774883728.0}
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP58071') HTTP/1.1" 204 0
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_b9df22768e2694d55f37cd9d44ff5534.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_bcdd13498e05655a3fb706c32528a53c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_532f00b6eef5e5f47c8e1c36a33ef63f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM68891> (referer: https://www.auto1.com/v1/car-details-view/BM68891/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ07968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcc0f50>
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_9b8abc26dca0ac0068fac4f8862315e6.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_9b8abc26dca0ac0068fac4f8862315e6.jpg saved to cache
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_bac0bf6435e10ecc6ee3852a82f77da1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA31284> (referer: https://www.auto1.com/v1/car-details-view/CA31284/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb679d0>
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_b9df22768e2694d55f37cd9d44ff5534.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_b9df22768e2694d55f37cd9d44ff5534.jpg saved to cache
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb23950>
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_bcdd13498e05655a3fb706c32528a53c.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_bcdd13498e05655a3fb706c32528a53c.jpg saved to cache
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 72524a46-7194-594f-be70-a205886bb213
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8ef50>
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_532f00b6eef5e5f47c8e1c36a33ef63f.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_532f00b6eef5e5f47c8e1c36a33ef63f.jpg saved to cache
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3c28e30-faf7-55b7-b813-db14b82311a8 with identifier: BM68891
2026-03-28 18:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c28e30-faf7-55b7-b813-db14b82311a8 with scrape type 1
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_aaf240d02a135f43f9a2c208f58a869f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_aaf240d02a135f43f9a2c208f58a869f.jpg not downloaded yet
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_cf300d99ff23b045e254a215b9827e80.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_cf300d99ff23b045e254a215b9827e80.jpg not downloaded yet
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_2b46d64c6ada8fa7cd4574c95c305261.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_b8d5fa857565c5bd20379e7d1ae8b403.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_196655b6c2cfd49fa14e846835ab1ba4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_5b7c4503f909c430f0bca2ec2676cbcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5b7c4503f909c430f0bca2ec2676cbcf.jpg not downloaded yet
2026-03-28 18:40:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be79710>
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgef%252F74%252Fef74ce3a9bbacf341ef22f7446c8b351%252Fpa%252FJD18961_bac0bf6435e10ecc6ee3852a82f77da1.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_bac0bf6435e10ecc6ee3852a82f77da1.jpg saved to cache
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item beda420c-e987-5fc4-a7ac-944edc08e34e
2026-03-28 18:40:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: beda420c-e987-5fc4-a7ac-944edc08e34e, skipping ID generation
2026-03-28 18:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beda420c-e987-5fc4-a7ac-944edc08e34e with scrape type 1
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item beda420c-e987-5fc4-a7ac-944edc08e34e sending to next pipeline
2026-03-28 18:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beda420c-e987-5fc4-a7ac-944edc08e34e, identifier: JD18961
2026-03-28 18:40:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with identifier: CA31284
2026-03-28 18:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with scrape type 1
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_bd942787576bfd310caab920eb2c5716.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_bd942787576bfd310caab920eb2c5716.jpg not downloaded yet
2026-03-28 18:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beda420c-e987-5fc4-a7ac-944edc08e34e with identifier: JD18961
2026-03-28 18:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beda420c-e987-5fc4-a7ac-944edc08e34e with identifier: JD18961
2026-03-28 18:40:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beda420c-e987-5fc4-a7ac-944edc08e34e with identifier: JD18961 to the API
2026-03-28 18:40:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_bac0bf6435e10ecc6ee3852a82f77da1.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:42:39Z',
 'fuel_type': 'petrol',
 'id': 'beda420c-e987-5fc4-a7ac-944edc08e34e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD18961',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 87976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_5e682ffca5441a10f3fc5c81c90fd7a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_990e4d04a126a00e0de21a890d999f97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_532f00b6eef5e5f47c8e1c36a33ef63f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_ce479bb6b3d4fec95f34c376acfbf0db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_aab8ecca9fc837fddce621e5e25192d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_48de204ad446901d56bae2ea0a151211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_4432b84d24f5d9d0b327f9dba4871634.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_236b0027332904c3707a97b37546c5b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71029,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_1fb280d1dce7e5f7e0a747a362b53a76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beda420c-e987-5fc4-a7ac-944edc08e34e/beda420c-e987-5fc4-a7ac-944edc08e34e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2501235,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgef/74/ef74ce3a9bbacf341ef22f7446c8b351/pa/JD18961_bac0bf6435e10ecc6ee3852a82f77da1.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Night Edition AMG Line',
 'transmission': 'automatic',
 'trim': 'Night Edition AMG Line',
 'year': 2017}
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD18961%27 HTTP/1.1" 200 None
2026-03-28 18:40:28 [auto1.de] INFO: Saving data for JD18961: {'created_time': 1774723228.220236, 'last_price_update_time': 1774723228.220247, 'auction_closing_time': 1774885359.0}
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD18961') HTTP/1.1" 204 0
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_5258ff96b0caf05b6b747e92237e6534.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5258ff96b0caf05b6b747e92237e6534.jpg not downloaded yet
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_9f7e2b31119e5e66b53d643e4ad14823.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_9f7e2b31119e5e66b53d643e4ad14823.jpg not downloaded yet
2026-03-28 18:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_9f868767741829d7231cf76231147915.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcfded0>
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_2b46d64c6ada8fa7cd4574c95c305261.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_2b46d64c6ada8fa7cd4574c95c305261.jpg saved to cache
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc8a390>
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_b8d5fa857565c5bd20379e7d1ae8b403.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_b8d5fa857565c5bd20379e7d1ae8b403.jpg saved to cache
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 72524a46-7194-594f-be70-a205886bb213
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beda050>
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F7f%252F567f5ae4478e43852d78fad23c4fcbc1%252Fpa%252FKZ38664_196655b6c2cfd49fa14e846835ab1ba4.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_196655b6c2cfd49fa14e846835ab1ba4.jpg saved to cache
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 72524a46-7194-594f-be70-a205886bb213
2026-03-28 18:40:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 72524a46-7194-594f-be70-a205886bb213, skipping ID generation
2026-03-28 18:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72524a46-7194-594f-be70-a205886bb213 with scrape type 1
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 72524a46-7194-594f-be70-a205886bb213 sending to next pipeline
2026-03-28 18:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 72524a46-7194-594f-be70-a205886bb213, identifier: KZ38664
2026-03-28 18:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_40a7b1264c2504ec416d3a78603389c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_3c607a15974126a6ff1b101b75829aaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_3c607a15974126a6ff1b101b75829aaf.jpg not downloaded yet
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_032abc697ae33f4350477c768b0d25ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_032abc697ae33f4350477c768b0d25ec.jpg not downloaded yet
2026-03-28 18:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB74543> (referer: https://www.auto1.com/v1/car-details-view/JB74543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HX73394> (referer: https://www.auto1.com/v1/car-details-view/HX73394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM98970> (referer: https://www.auto1.com/v1/car-details-view/UM98970/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP81333> (referer: https://www.auto1.com/v1/car-details-view/PP81333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 72524a46-7194-594f-be70-a205886bb213 with identifier: KZ38664
2026-03-28 18:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 72524a46-7194-594f-be70-a205886bb213 with identifier: KZ38664
2026-03-28 18:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 72524a46-7194-594f-be70-a205886bb213 with identifier: KZ38664 to the API
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_196655b6c2cfd49fa14e846835ab1ba4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:54:49Z',
 'fuel_type': 'petrol',
 'id': '72524a46-7194-594f-be70-a205886bb213',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ38664',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Volvo',
 'model': 'C30',
 'odometer': 284737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_b8d5fa857565c5bd20379e7d1ae8b403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_999eddf8151def617c4a406109104ed8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_196655b6c2cfd49fa14e846835ab1ba4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_bcdd13498e05655a3fb706c32528a53c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_72524a46-7194-594f-be70-a205886bb213/72524a46-7194-594f-be70-a205886bb213_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img56/7f/567f5ae4478e43852d78fad23c4fcbc1/pa/KZ38664_7673fbd9975ea076721adaf4a14f4b7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-02-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo C30 1.8 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2007}
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ38664%27 HTTP/1.1" 200 None
2026-03-28 18:40:28 [auto1.de] INFO: Saving data for KZ38664: {'created_time': 1774723228.879542, 'last_price_update_time': 1774723228.879555, 'auction_closing_time': 1774886089.0}
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ38664') HTTP/1.1" 204 0
2026-03-28 18:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_cf300d99ff23b045e254a215b9827e80.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_aaf240d02a135f43f9a2c208f58a869f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_586a9aae838169ba7ceba38ea9cb8717.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_586a9aae838169ba7ceba38ea9cb8717.jpg not downloaded yet
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_426229dc2474dec94aaff2891539b6cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_426229dc2474dec94aaff2891539b6cf.jpg not downloaded yet
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b169a90>
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg29%252F3a%252F293a19eefeb30416fa5ef7a90dcc84d9%252Fpa%252FBH61935_9f868767741829d7231cf76231147915.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_9f868767741829d7231cf76231147915.jpg saved to cache
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4166df80-56af-5b93-9dbd-2fae34c82122
2026-03-28 18:40:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4166df80-56af-5b93-9dbd-2fae34c82122, skipping ID generation
2026-03-28 18:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4166df80-56af-5b93-9dbd-2fae34c82122 with scrape type 1
2026-03-28 18:40:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4166df80-56af-5b93-9dbd-2fae34c82122 sending to next pipeline
2026-03-28 18:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4166df80-56af-5b93-9dbd-2fae34c82122, identifier: BH61935
2026-03-28 18:40:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4166df80-56af-5b93-9dbd-2fae34c82122 with identifier: BH61935
2026-03-28 18:40:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4166df80-56af-5b93-9dbd-2fae34c82122 with identifier: BH61935
2026-03-28 18:40:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4166df80-56af-5b93-9dbd-2fae34c82122 with identifier: BH61935 to the API
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_9f868767741829d7231cf76231147915.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:24:52Z',
 'fuel_type': 'diesel',
 'id': '4166df80-56af-5b93-9dbd-2fae34c82122',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH61935',
 'listing': 'auction',
 'location': 'DE, Worms',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 260085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_1d9ac1c540fe2fdd419a0a621bcb32dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96876,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_39c5b229e0ffd63418169a748650e39c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_9f868767741829d7231cf76231147915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_00927cf20faf3208c6b22d19ccba2f2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_f155ae72d64b49a166f77524fd674878.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4166df80-56af-5b93-9dbd-2fae34c82122/4166df80-56af-5b93-9dbd-2fae34c82122_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img29/3a/293a19eefeb30416fa5ef7a90dcc84d9/pa/BH61935_817533a4254388513c88f55c163778bb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH61935%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [auto1.de] INFO: Saving data for BH61935: {'created_time': 1774723229.427217, 'last_price_update_time': 1774723229.427232, 'auction_closing_time': 1774884292.0}
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH61935') HTTP/1.1" 204 0
2026-03-28 18:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_2814bfcdfebed17ca3bd7be6b58ad56b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_5e5557f67dca66468b89362e9072c6c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5e5557f67dca66468b89362e9072c6c0.jpg not downloaded yet
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_2b28d08dd505cbd38ccf1b4422399b95.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_2b28d08dd505cbd38ccf1b4422399b95.jpg not downloaded yet
2026-03-28 18:40:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be72f50>
2026-03-28 18:40:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F84%252Fd6846d54b899697e6a195122ad2f130d%252Fpa%252FEU91257_40a7b1264c2504ec416d3a78603389c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_40a7b1264c2504ec416d3a78603389c2.jpg saved to cache
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84eebff7-5356-582c-a98d-defdbfe75918
2026-03-28 18:40:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84eebff7-5356-582c-a98d-defdbfe75918, skipping ID generation
2026-03-28 18:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84eebff7-5356-582c-a98d-defdbfe75918 with scrape type 1
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84eebff7-5356-582c-a98d-defdbfe75918 sending to next pipeline
2026-03-28 18:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84eebff7-5356-582c-a98d-defdbfe75918, identifier: EU91257
2026-03-28 18:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with identifier: JB74543
2026-03-28 18:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with scrape type 1
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_333b073ab2888ed8f6795af032796875.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_333b073ab2888ed8f6795af032796875.jpg not downloaded yet
2026-03-28 18:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42e4d640-e247-5413-87d3-1dd2d1038c7e with identifier: HX73394
2026-03-28 18:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42e4d640-e247-5413-87d3-1dd2d1038c7e with scrape type 1
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 42e4d640-e247-5413-87d3-1dd2d1038c7e
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_74716c69a95c3be885f5ef13156a7418.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_74716c69a95c3be885f5ef13156a7418.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_48858a2a8d2903b74124c9ebf1df82f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_48858a2a8d2903b74124c9ebf1df82f5.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_619dc12ec3075477438f87f073d4a9e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_619dc12ec3075477438f87f073d4a9e8.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_3140fb4831954f8ac481365dac83bc09.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_3140fb4831954f8ac481365dac83bc09.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_b029a640d0828d0fc41c1de08bce7784.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_b029a640d0828d0fc41c1de08bce7784.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_75719209940aa1eb2598055a0eff297d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_75719209940aa1eb2598055a0eff297d.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_bc86d94819c7858cddb74ea4702553a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_bc86d94819c7858cddb74ea4702553a9.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_9d01bfa0c496149989cae5f25c64e21e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_9d01bfa0c496149989cae5f25c64e21e.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_2e9d2cdab0652d79e2fb0ab1d8f6f398.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_2e9d2cdab0652d79e2fb0ab1d8f6f398.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F80%252Fd580b6d622fcb28649dff0405ad1cdec%252Fpa%252FHX73394_292c3cf972b2753b11f9e1b2781a199d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_292c3cf972b2753b11f9e1b2781a199d.jpg already downloaded
2026-03-28 18:40:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42e4d640-e247-5413-87d3-1dd2d1038c7e, identifier: HX73394
2026-03-28 18:40:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with identifier: UM98970
2026-03-28 18:40:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with scrape type 1
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_ba4253451590b4959f7e5289b11c25ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_ba4253451590b4959f7e5289b11c25ec.jpg already downloaded
2026-03-28 18:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_6b75d7d49289fb72aa6cb0283cdfcd3e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_6b75d7d49289fb72aa6cb0283cdfcd3e.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_a72e896aafff92706a08af7ff96b3b02.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_a72e896aafff92706a08af7ff96b3b02.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_47dbe6da3f21c444ea7b4e79696ce918.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_47dbe6da3f21c444ea7b4e79696ce918.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_9386177c4b4bd5b23b35a67995869d6b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_9386177c4b4bd5b23b35a67995869d6b.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_03fe899b7e427d947278b03ab6191d05.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_03fe899b7e427d947278b03ab6191d05.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_886acddb676a0fba8f94b6418b1a8364.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_886acddb676a0fba8f94b6418b1a8364.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_94375144b136faf07f0076d03c6b1586.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_94375144b136faf07f0076d03c6b1586.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_bfe7a2c8d727453ddf72611f8eec5211.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_bfe7a2c8d727453ddf72611f8eec5211.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fee%252Fb9ee4641911fc490554a63f9362a8ae8%252Fpa%252FUM98970_3de12ea909023fd3c0d1f898ea197434.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_3de12ea909023fd3c0d1f898ea197434.jpg already downloaded
2026-03-28 18:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1, identifier: UM98970
2026-03-28 18:40:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4118baf-ede4-5953-9306-346e6bc8ce17 with identifier: PP81333
2026-03-28 18:40:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4118baf-ede4-5953-9306-346e6bc8ce17 with scrape type 1
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4118baf-ede4-5953-9306-346e6bc8ce17
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_204c780454162bfc19aa04959628c54b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_204c780454162bfc19aa04959628c54b.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_18f4b1a4b39bd47f7834203f0f68e0ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_18f4b1a4b39bd47f7834203f0f68e0ca.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_b308a8a4188fff69b2703aab9b6bfdd7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_b308a8a4188fff69b2703aab9b6bfdd7.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_c645ee5e47699b714959ba3434479dce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_c645ee5e47699b714959ba3434479dce.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_e0b2712c351bd87d74b7b2348a48b85f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_e0b2712c351bd87d74b7b2348a48b85f.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_b69d8d0519d9e3837c43db8baa502468.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_b69d8d0519d9e3837c43db8baa502468.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_c10b467a0e9c79d34586f956b50cb0ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_c10b467a0e9c79d34586f956b50cb0ad.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_88a97f9c85d84ee0596baf36a0eeb402.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_88a97f9c85d84ee0596baf36a0eeb402.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_2823e3380c4901a4cf20a42c3484edc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_2823e3380c4901a4cf20a42c3484edc1.jpg already downloaded
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F94%252F47944a8836aee8947efff0744a6ed162%252Fpa%252FPP81333_f3303d2b6a348d9ff15ba5d377614c13.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_f3303d2b6a348d9ff15ba5d377614c13.jpg already downloaded
2026-03-28 18:40:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4118baf-ede4-5953-9306-346e6bc8ce17, identifier: PP81333
2026-03-28 18:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5b7c4503f909c430f0bca2ec2676cbcf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5258ff96b0caf05b6b747e92237e6534.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_bd942787576bfd310caab920eb2c5716.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_9f7e2b31119e5e66b53d643e4ad14823.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD79813/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84eebff7-5356-582c-a98d-defdbfe75918 with identifier: EU91257
2026-03-28 18:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84eebff7-5356-582c-a98d-defdbfe75918 with identifier: EU91257
2026-03-28 18:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84eebff7-5356-582c-a98d-defdbfe75918 with identifier: EU91257 to the API
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_40a7b1264c2504ec416d3a78603389c2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:49:52Z',
 'fuel_type': 'diesel',
 'id': '84eebff7-5356-582c-a98d-defdbfe75918',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU91257',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 260092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93218,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_40a7b1264c2504ec416d3a78603389c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87300,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_28914bdc5126137dd5dffb2369654109.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_2b46d64c6ada8fa7cd4574c95c305261.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_b9df22768e2694d55f37cd9d44ff5534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74731,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_54193b08587f5eacf43674c2483601e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_9570602a9ca7b6b103f7e2fe95290abb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_21697a6d5712276a636119f514c208c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_9b8abc26dca0ac0068fac4f8862315e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87109,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_51556c2c497d6966e36661c46a199288.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84eebff7-5356-582c-a98d-defdbfe75918/84eebff7-5356-582c-a98d-defdbfe75918_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/84/d6846d54b899697e6a195122ad2f130d/pa/EU91257_5e8df74ecb7f60127e689f413d9fda9c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-17',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi Generation Evado',
 'transmission': 'manual',
 'trim': 'Generation Evado',
 'year': 2012}
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU91257%27 HTTP/1.1" 200 None
2026-03-28 18:40:30 [auto1.de] INFO: Saving data for EU91257: {'created_time': 1774723230.840428, 'last_price_update_time': 1774723230.84044, 'auction_closing_time': 1774885792.0}
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU91257') HTTP/1.1" 204 0
2026-03-28 18:40:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42e4d640-e247-5413-87d3-1dd2d1038c7e with identifier: HX73394
2026-03-28 18:40:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42e4d640-e247-5413-87d3-1dd2d1038c7e with identifier: HX73394
2026-03-28 18:40:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42e4d640-e247-5413-87d3-1dd2d1038c7e with identifier: HX73394 to the API
2026-03-28 18:40:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HX73394>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:14:31Z',
 'fuel_type': 'petrol',
 'id': '42e4d640-e247-5413-87d3-1dd2d1038c7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX73394',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_74716c69a95c3be885f5ef13156a7418.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_48858a2a8d2903b74124c9ebf1df82f5.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_619dc12ec3075477438f87f073d4a9e8.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_3140fb4831954f8ac481365dac83bc09.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_b029a640d0828d0fc41c1de08bce7784.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_75719209940aa1eb2598055a0eff297d.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_bc86d94819c7858cddb74ea4702553a9.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_9d01bfa0c496149989cae5f25c64e21e.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_2e9d2cdab0652d79e2fb0ab1d8f6f398.jpg',
                'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_292c3cf972b2753b11f9e1b2781a199d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_74716c69a95c3be885f5ef13156a7418.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_48858a2a8d2903b74124c9ebf1df82f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_619dc12ec3075477438f87f073d4a9e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_3140fb4831954f8ac481365dac83bc09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_b029a640d0828d0fc41c1de08bce7784.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_75719209940aa1eb2598055a0eff297d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66156,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_bc86d94819c7858cddb74ea4702553a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_9d01bfa0c496149989cae5f25c64e21e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71112,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_2e9d2cdab0652d79e2fb0ab1d8f6f398.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_42e4d640-e247-5413-87d3-1dd2d1038c7e/42e4d640-e247-5413-87d3-1dd2d1038c7e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/80/d580b6d622fcb28649dff0405ad1cdec/pa/HX73394_292c3cf972b2753b11f9e1b2781a199d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'BlueMotion Tech',
 'year': 2015}
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX73394%27 HTTP/1.1" 200 None
2026-03-28 18:40:31 [auto1.de] INFO: Saving data for HX73394: {'created_time': 1774723231.37604, 'last_price_update_time': 1774723231.376051, 'auction_closing_time': 1774883671.0}
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX73394') HTTP/1.1" 204 0
2026-03-28 18:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with identifier: UM98970
2026-03-28 18:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with identifier: UM98970
2026-03-28 18:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ac80fd7-8b47-5edc-9d9e-e476ef270bd1 with identifier: UM98970 to the API
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UM98970>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:46:14Z',
 'fuel_type': 'petrol',
 'id': '5ac80fd7-8b47-5edc-9d9e-e476ef270bd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM98970',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 151495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_ba4253451590b4959f7e5289b11c25ec.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_6b75d7d49289fb72aa6cb0283cdfcd3e.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_a72e896aafff92706a08af7ff96b3b02.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_47dbe6da3f21c444ea7b4e79696ce918.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_9386177c4b4bd5b23b35a67995869d6b.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_03fe899b7e427d947278b03ab6191d05.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_886acddb676a0fba8f94b6418b1a8364.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_94375144b136faf07f0076d03c6b1586.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_bfe7a2c8d727453ddf72611f8eec5211.jpg',
                'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_3de12ea909023fd3c0d1f898ea197434.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_ba4253451590b4959f7e5289b11c25ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_6b75d7d49289fb72aa6cb0283cdfcd3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64266,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_a72e896aafff92706a08af7ff96b3b02.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_47dbe6da3f21c444ea7b4e79696ce918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_9386177c4b4bd5b23b35a67995869d6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_03fe899b7e427d947278b03ab6191d05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_886acddb676a0fba8f94b6418b1a8364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73707,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_94375144b136faf07f0076d03c6b1586.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71365,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_bfe7a2c8d727453ddf72611f8eec5211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ac80fd7-8b47-5edc-9d9e-e476ef270bd1/5ac80fd7-8b47-5edc-9d9e-e476ef270bd1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/ee/b9ee4641911fc490554a63f9362a8ae8/pa/UM98970_3de12ea909023fd3c0d1f898ea197434.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM98970%27 HTTP/1.1" 200 None
2026-03-28 18:40:31 [auto1.de] INFO: Saving data for UM98970: {'created_time': 1774723231.725388, 'last_price_update_time': 1774723231.725403, 'auction_closing_time': 1774885574.0}
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM98970') HTTP/1.1" 204 0
2026-03-28 18:40:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4118baf-ede4-5953-9306-346e6bc8ce17 with identifier: PP81333
2026-03-28 18:40:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4118baf-ede4-5953-9306-346e6bc8ce17 with identifier: PP81333
2026-03-28 18:40:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4118baf-ede4-5953-9306-346e6bc8ce17 with identifier: PP81333 to the API
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PP81333>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:58:53Z',
 'fuel_type': 'diesel',
 'id': 'c4118baf-ede4-5953-9306-346e6bc8ce17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP81333',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 217338,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_204c780454162bfc19aa04959628c54b.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_18f4b1a4b39bd47f7834203f0f68e0ca.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_b308a8a4188fff69b2703aab9b6bfdd7.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_c645ee5e47699b714959ba3434479dce.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_e0b2712c351bd87d74b7b2348a48b85f.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_b69d8d0519d9e3837c43db8baa502468.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_c10b467a0e9c79d34586f956b50cb0ad.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_88a97f9c85d84ee0596baf36a0eeb402.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_2823e3380c4901a4cf20a42c3484edc1.jpg',
                'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_f3303d2b6a348d9ff15ba5d377614c13.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 373828,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_204c780454162bfc19aa04959628c54b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63980,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_18f4b1a4b39bd47f7834203f0f68e0ca.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64363,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_b308a8a4188fff69b2703aab9b6bfdd7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59380,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_c645ee5e47699b714959ba3434479dce.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49910,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_e0b2712c351bd87d74b7b2348a48b85f.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 307507,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_b69d8d0519d9e3837c43db8baa502468.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43912,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_c10b467a0e9c79d34586f956b50cb0ad.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47615,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_88a97f9c85d84ee0596baf36a0eeb402.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63222,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_2823e3380c4901a4cf20a42c3484edc1.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4118baf-ede4-5953-9306-346e6bc8ce17/c4118baf-ede4-5953-9306-346e6bc8ce17_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55396,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img47/94/47944a8836aee8947efff0744a6ed162/pa/PP81333_f3303d2b6a348d9ff15ba5d377614c13.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-21',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2014}
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP81333%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [auto1.de] INFO: Saving data for PP81333: {'created_time': 1774723232.110278, 'last_price_update_time': 1774723232.110289, 'auction_closing_time': 1774886333.0}
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP81333') HTTP/1.1" 204 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_8bde6a1728b48166956c3d17f67a97ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_8bde6a1728b48166956c3d17f67a97ca.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_615b41bb1d165eae5b1e6fa45f4b5568.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_615b41bb1d165eae5b1e6fa45f4b5568.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_e24b77d9d29f490ab8d5c3043d221c17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e24b77d9d29f490ab8d5c3043d221c17.jpg not downloaded yet
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b250050>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_cf300d99ff23b045e254a215b9827e80.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_cf300d99ff23b045e254a215b9827e80.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb02790>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_aaf240d02a135f43f9a2c208f58a869f.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_aaf240d02a135f43f9a2c208f58a869f.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ07968> (referer: https://www.auto1.com/v1/car-details-view/SZ07968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VU61436/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_8ab31a96dcf95621b374bbda7b578771.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_8ab31a96dcf95621b374bbda7b578771.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_9f1c0a23b879bea022776bd27bab2bf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_9f1c0a23b879bea022776bd27bab2bf0.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_b1b5a29e74c4da4a7ca1edfae4abdeea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_b1b5a29e74c4da4a7ca1edfae4abdeea.jpg not downloaded yet
2026-03-28 18:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_9969d8e9f3bc36c82e66ea7ce91d330b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb5e2d0>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_2814bfcdfebed17ca3bd7be6b58ad56b.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_2814bfcdfebed17ca3bd7be6b58ad56b.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc15f90>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_5b7c4503f909c430f0bca2ec2676cbcf.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5b7c4503f909c430f0bca2ec2676cbcf.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d15e50>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_5258ff96b0caf05b6b747e92237e6534.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5258ff96b0caf05b6b747e92237e6534.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd78dd0>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_bd942787576bfd310caab920eb2c5716.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_bd942787576bfd310caab920eb2c5716.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1ff50>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_9f7e2b31119e5e66b53d643e4ad14823.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_9f7e2b31119e5e66b53d643e4ad14823.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_333b073ab2888ed8f6795af032796875.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_44a7243c139d50420415b4b6a961efd8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_44a7243c139d50420415b4b6a961efd8.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_8be7e3ce19ae03ce86b36faff520bc56.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_8be7e3ce19ae03ce86b36faff520bc56.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_e5e346acdedbadef886f773ceb5bd21a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e5e346acdedbadef886f773ceb5bd21a.jpg not downloaded yet
2026-03-28 18:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_426229dc2474dec94aaff2891539b6cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_5615cc164b2cafd5ab0b8d66cd0908f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_ba19b9fc3d89a1b81fc5d48d885bdfc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_ba19b9fc3d89a1b81fc5d48d885bdfc1.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_bb4dd147c3de4bb5643b386613ce6f11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_bb4dd147c3de4bb5643b386613ce6f11.jpg not downloaded yet
2026-03-28 18:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71d3247a-6966-5772-a47d-7b7133156e5a with identifier: SZ07968
2026-03-28 18:40:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71d3247a-6966-5772-a47d-7b7133156e5a with scrape type 1
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_d6a25d43aa7f9da45c5f58a3564cbf67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_d6a25d43aa7f9da45c5f58a3564cbf67.jpg not downloaded yet
2026-03-28 18:40:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b037790>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_9969d8e9f3bc36c82e66ea7ce91d330b.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_9969d8e9f3bc36c82e66ea7ce91d330b.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5e5557f67dca66468b89362e9072c6c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_564ce31dbd288896fa57b209ecfc7d35.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_564ce31dbd288896fa57b209ecfc7d35.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_97c4e9704d0bd18608e61de0856215d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_97c4e9704d0bd18608e61de0856215d8.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_8f103947f1972261ec30539ca7d98f1e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_8f103947f1972261ec30539ca7d98f1e.jpg not downloaded yet
2026-03-28 18:40:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_f7fcad66f24074d631c3146aa0d94ab7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_f7fcad66f24074d631c3146aa0d94ab7.jpg not downloaded yet
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_b318f38b80f508cb32319802814e70a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_b318f38b80f508cb32319802814e70a0.jpg not downloaded yet
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b180690>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_333b073ab2888ed8f6795af032796875.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_333b073ab2888ed8f6795af032796875.jpg saved to cache
2026-03-28 18:40:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0216d0>
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_426229dc2474dec94aaff2891539b6cf.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_426229dc2474dec94aaff2891539b6cf.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b289990>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_5615cc164b2cafd5ab0b8d66cd0908f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_5615cc164b2cafd5ab0b8d66cd0908f6.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_586a9aae838169ba7ceba38ea9cb8717.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e5e346acdedbadef886f773ceb5bd21a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_05a7e536f9b2559c201f3966e5e95e06.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_05a7e536f9b2559c201f3966e5e95e06.jpg not downloaded yet
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_8bf2bafb0bf8e468e2ae7ea107e76ef2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_8bf2bafb0bf8e468e2ae7ea107e76ef2.jpg not downloaded yet
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_032abc697ae33f4350477c768b0d25ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_c03aeb8483d8d9e64424e54444a97b38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_c03aeb8483d8d9e64424e54444a97b38.jpg not downloaded yet
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_eb62a34f612691893584503404afe993.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_eb62a34f612691893584503404afe993.jpg not downloaded yet
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb68ad0>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_5e5557f67dca66468b89362e9072c6c0.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5e5557f67dca66468b89362e9072c6c0.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_ad237a95e153e5c31796ee6cf43f7f18.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_ad237a95e153e5c31796ee6cf43f7f18.jpg not downloaded yet
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_38a2acfc406f4445d18644fb67db7b72.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_38a2acfc406f4445d18644fb67db7b72.jpg not downloaded yet
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_44a7243c139d50420415b4b6a961efd8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_0fcb519652e81b7980aeb42d81ce4a86.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_f08fe392efa62cfe5f512c2fbf6857aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_f08fe392efa62cfe5f512c2fbf6857aa.jpg not downloaded yet
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b150090>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_586a9aae838169ba7ceba38ea9cb8717.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_586a9aae838169ba7ceba38ea9cb8717.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbe5210>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_e5e346acdedbadef886f773ceb5bd21a.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e5e346acdedbadef886f773ceb5bd21a.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd33450>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_032abc697ae33f4350477c768b0d25ec.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_032abc697ae33f4350477c768b0d25ec.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_b1b5a29e74c4da4a7ca1edfae4abdeea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_a769aa7c4909bb301cc23e353ffe7f6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_a769aa7c4909bb301cc23e353ffe7f6d.jpg not downloaded yet
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_4b558a5948502c1f08583ca6a9b74b59.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_8be7e3ce19ae03ce86b36faff520bc56.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_9613d408d81300015d1ba0df9f537326.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_9613d408d81300015d1ba0df9f537326.jpg not downloaded yet
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_9f1c0a23b879bea022776bd27bab2bf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_236c20e0b64df24b2e05505c06acb809.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_236c20e0b64df24b2e05505c06acb809.jpg not downloaded yet
2026-03-28 18:40:33 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 6005 | hits on page: 40
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b182c50>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_44a7243c139d50420415b4b6a961efd8.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_44a7243c139d50420415b4b6a961efd8.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b219a10>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_0fcb519652e81b7980aeb42d81ce4a86.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_0fcb519652e81b7980aeb42d81ce4a86.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_b318f38b80f508cb32319802814e70a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_f7fcad66f24074d631c3146aa0d94ab7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_8bf2bafb0bf8e468e2ae7ea107e76ef2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_eb62a34f612691893584503404afe993.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [auto1.de] INFO: Scrape type for RS29828: 1
2026-03-28 18:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:33 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-28 18:40:33 [auto1.de] INFO: Scrape type for WB65429: 2
2026-03-28 18:40:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24609bfe-3e13-53ba-9969-0efe212a8482 with identifier: WB65429
2026-03-28 18:40:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24609bfe-3e13-53ba-9969-0efe212a8482 with scrape type 2
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24609bfe-3e13-53ba-9969-0efe212a8482 with scrape type 2
2026-03-28 18:40:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24609bfe-3e13-53ba-9969-0efe212a8482, identifier: WB65429
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b077fd0>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_b1b5a29e74c4da4a7ca1edfae4abdeea.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_b1b5a29e74c4da4a7ca1edfae4abdeea.jpg saved to cache
2026-03-28 18:40:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbba310>
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252F5d%252F4f5de5f1b7bdf5c2430eeea8bfd75f1d%252Fpa%252FXZ09557_4b558a5948502c1f08583ca6a9b74b59.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_4b558a5948502c1f08583ca6a9b74b59.jpg saved to cache
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4
2026-03-28 18:40:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39fec39b-f5fd-5bb8-95ea-0689841fdca4, skipping ID generation
2026-03-28 18:40:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with scrape type 1
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39fec39b-f5fd-5bb8-95ea-0689841fdca4 sending to next pipeline
2026-03-28 18:40:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39fec39b-f5fd-5bb8-95ea-0689841fdca4, identifier: XZ09557
2026-03-28 18:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be80d50>
2026-03-28 18:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_8be7e3ce19ae03ce86b36faff520bc56.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_8be7e3ce19ae03ce86b36faff520bc56.jpg saved to cache
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb69690>
2026-03-28 18:40:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_9f1c0a23b879bea022776bd27bab2bf0.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_9f1c0a23b879bea022776bd27bab2bf0.jpg saved to cache
2026-03-28 18:40:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_c03aeb8483d8d9e64424e54444a97b38.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24609bfe-3e13-53ba-9969-0efe212a8482 with identifier: WB65429
2026-03-28 18:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24609bfe-3e13-53ba-9969-0efe212a8482 with identifier: WB65429
2026-03-28 18:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24609bfe-3e13-53ba-9969-0efe212a8482 with identifier: WB65429 to the API
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'petrol',
 'id': '24609bfe-3e13-53ba-9969-0efe212a8482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB65429',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 219830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-02',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 GDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB65429%27 HTTP/1.1" 200 None
2026-03-28 18:40:34 [auto1.de] INFO: Saving data for WB65429: {'auction_closing_time': 1774884726.0, 'created_time': 1774033097.931131, 'last_price_update_time': 1774723234.660119}
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB65429') HTTP/1.1" 204 0
2026-03-28 18:40:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with identifier: XZ09557
2026-03-28 18:40:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with identifier: XZ09557
2026-03-28 18:40:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39fec39b-f5fd-5bb8-95ea-0689841fdca4 with identifier: XZ09557 to the API
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_4b558a5948502c1f08583ca6a9b74b59.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 341,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '6.4L',
 'engine_horse_power': 468,
 'expiration_date': '2026-03-30T15:30:00Z',
 'fuel_type': 'petrol',
 'id': '39fec39b-f5fd-5bb8-95ea-0689841fdca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ09557',
 'listing': 'auction',
 'location': 'DE, Heilbronn',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 129719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3059572,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_4b558a5948502c1f08583ca6a9b74b59.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3161166,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_0fcb519652e81b7980aeb42d81ce4a86.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67381,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_349cb786c163cb67748f59f5d448f58a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2983087,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_9969d8e9f3bc36c82e66ea7ce91d330b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3250962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_2814bfcdfebed17ca3bd7be6b58ad56b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_d7ee2c9dc7788d73ee103c53bf0c1de0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_c125beacd88a8cff3422f10ab5bbf9cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3026054,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_b4bde1455428a37cd4785490b4c4e8f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2867911,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_d76b9f06b1e2bc9b92ff4fe797b6cc71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fec39b-f5fd-5bb8-95ea-0689841fdca4/39fec39b-f5fd-5bb8-95ea-0689841fdca4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89271,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/5d/4f5de5f1b7bdf5c2430eeea8bfd75f1d/pa/XZ09557_28faf0472b4be86b42ce286a7407fdc6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 6.4 V8 HEMI SRT',
 'transmission': 'automatic',
 'trim': 'HEMI SRT',
 'year': 2019}
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ09557%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Saving data for XZ09557: {'created_time': 1774723235.045054, 'last_price_update_time': 1774723235.045066, 'auction_closing_time': 1774884600.0}
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ09557') HTTP/1.1" 204 0
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Scrape type for BV82977: 1
2026-03-28 18:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_a769aa7c4909bb301cc23e353ffe7f6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_38a2acfc406f4445d18644fb67db7b72.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD79813> (referer: https://www.auto1.com/v1/car-details-view/YD79813/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_9613d408d81300015d1ba0df9f537326.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_236c20e0b64df24b2e05505c06acb809.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Scrape type for ZV11386: 1
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VU61436> (referer: https://www.auto1.com/v1/car-details-view/VU61436/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b19c5d0>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_b318f38b80f508cb32319802814e70a0.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_b318f38b80f508cb32319802814e70a0.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd88910>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_f7fcad66f24074d631c3146aa0d94ab7.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_f7fcad66f24074d631c3146aa0d94ab7.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b244ad0>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_8bf2bafb0bf8e468e2ae7ea107e76ef2.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_8bf2bafb0bf8e468e2ae7ea107e76ef2.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc02690>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_eb62a34f612691893584503404afe993.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_eb62a34f612691893584503404afe993.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b270d50>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_c03aeb8483d8d9e64424e54444a97b38.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_c03aeb8483d8d9e64424e54444a97b38.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Scrape type for FW24707: 1
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_ad237a95e153e5c31796ee6cf43f7f18.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_f08fe392efa62cfe5f512c2fbf6857aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-28 18:40:35 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [auto1.de] INFO: Scrape type for NE29415: 1
2026-03-28 18:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b055b10>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_a769aa7c4909bb301cc23e353ffe7f6d.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_a769aa7c4909bb301cc23e353ffe7f6d.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd32e90>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_38a2acfc406f4445d18644fb67db7b72.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_38a2acfc406f4445d18644fb67db7b72.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2a508ed-99bf-546f-94d2-377440141fdc with identifier: YD79813
2026-03-28 18:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a508ed-99bf-546f-94d2-377440141fdc with scrape type 1
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_b649e22af0d5dcac950fec4bf18fce67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_b649e22af0d5dcac950fec4bf18fce67.jpg not downloaded yet
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1d5990>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_9613d408d81300015d1ba0df9f537326.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_9613d408d81300015d1ba0df9f537326.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7dcd0>
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_236c20e0b64df24b2e05505c06acb809.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_236c20e0b64df24b2e05505c06acb809.jpg saved to cache
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with identifier: VU61436
2026-03-28 18:40:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with scrape type 1
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9aaa3b50-c399-50fd-996b-9ced9fba5ed1
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_08148b297677dd9847b37c4d75f933af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_08148b297677dd9847b37c4d75f933af.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_c15d0f29234511a5b925c20cf8268e4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_c15d0f29234511a5b925c20cf8268e4c.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_67ff114ed062b6986f56ccb36ae873e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_67ff114ed062b6986f56ccb36ae873e8.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_52615ac317d5c246db3231d9a045bf04.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_52615ac317d5c246db3231d9a045bf04.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_53428838761c377d23142ca251578994.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_53428838761c377d23142ca251578994.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_2a17ef222162b36f759a6fcb51239d84.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_2a17ef222162b36f759a6fcb51239d84.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_23f4e1de4055e949139224b1aadf9fae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_23f4e1de4055e949139224b1aadf9fae.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_4dbd1f24feebf23626703e2ba295b9e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_4dbd1f24feebf23626703e2ba295b9e7.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_5c03440a5efd87194cbe8356d5d46074.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_5c03440a5efd87194cbe8356d5d46074.jpg already downloaded
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg48%252Fed%252F48ed3d18852f55758a5cdab7b945ced6%252Fpa%252FVU61436_3701a4dc18ee2f72a5dd92bf55f2f50f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_3701a4dc18ee2f72a5dd92bf55f2f50f.jpg already downloaded
2026-03-28 18:40:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1, identifier: VU61436
2026-03-28 18:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_8f103947f1972261ec30539ca7d98f1e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with identifier: VU61436
2026-03-28 18:40:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with identifier: VU61436
2026-03-28 18:40:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9aaa3b50-c399-50fd-996b-9ced9fba5ed1 with identifier: VU61436 to the API
2026-03-28 18:40:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VU61436>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:46:26Z',
 'fuel_type': 'petrol',
 'id': '9aaa3b50-c399-50fd-996b-9ced9fba5ed1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU61436',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'BMW',
 'model': '3er',
 'odometer': 80573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_08148b297677dd9847b37c4d75f933af.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_c15d0f29234511a5b925c20cf8268e4c.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_67ff114ed062b6986f56ccb36ae873e8.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_52615ac317d5c246db3231d9a045bf04.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_53428838761c377d23142ca251578994.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_2a17ef222162b36f759a6fcb51239d84.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_23f4e1de4055e949139224b1aadf9fae.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_4dbd1f24feebf23626703e2ba295b9e7.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_5c03440a5efd87194cbe8356d5d46074.jpg',
                'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_3701a4dc18ee2f72a5dd92bf55f2f50f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75629,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_08148b297677dd9847b37c4d75f933af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_c15d0f29234511a5b925c20cf8268e4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_67ff114ed062b6986f56ccb36ae873e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59412,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_52615ac317d5c246db3231d9a045bf04.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_53428838761c377d23142ca251578994.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_2a17ef222162b36f759a6fcb51239d84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_23f4e1de4055e949139224b1aadf9fae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_4dbd1f24feebf23626703e2ba295b9e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_5c03440a5efd87194cbe8356d5d46074.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9aaa3b50-c399-50fd-996b-9ced9fba5ed1/9aaa3b50-c399-50fd-996b-9ced9fba5ed1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img48/ed/48ed3d18852f55758a5cdab7b945ced6/pa/VU61436_3701a4dc18ee2f72a5dd92bf55f2f50f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 316i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU61436%27 HTTP/1.1" 200 None
2026-03-28 18:40:36 [auto1.de] INFO: Saving data for VU61436: {'created_time': 1774723236.12446, 'last_price_update_time': 1774723236.124473, 'auction_closing_time': 1774885586.0}
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU61436') HTTP/1.1" 204 0
2026-03-28 18:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_97c4e9704d0bd18608e61de0856215d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:36 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-28 18:40:36 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-28 18:40:36 [auto1.de] INFO: Scrape type for LF31183: 2
2026-03-28 18:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33854af1-85d2-5344-bd2e-713c7848f050 with identifier: LF31183
2026-03-28 18:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33854af1-85d2-5344-bd2e-713c7848f050 with scrape type 2
2026-03-28 18:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33854af1-85d2-5344-bd2e-713c7848f050 with scrape type 2
2026-03-28 18:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33854af1-85d2-5344-bd2e-713c7848f050, identifier: LF31183
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_3e556541061947bd90159b3497a021b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_3e556541061947bd90159b3497a021b2.jpg not downloaded yet
2026-03-28 18:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33854af1-85d2-5344-bd2e-713c7848f050 with identifier: LF31183
2026-03-28 18:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33854af1-85d2-5344-bd2e-713c7848f050 with identifier: LF31183
2026-03-28 18:40:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33854af1-85d2-5344-bd2e-713c7848f050 with identifier: LF31183 to the API
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:04:26Z',
 'fuel_type': 'petrol',
 'id': '33854af1-85d2-5344-bd2e-713c7848f050',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF31183',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 142053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-09',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2017}
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF31183%27 HTTP/1.1" 200 None
2026-03-28 18:40:36 [auto1.de] INFO: Saving data for LF31183: {'auction_closing_time': 1774883066.0, 'created_time': 1774031963.181135, 'last_price_update_time': 1774723236.767195}
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF31183') HTTP/1.1" 204 0
2026-03-28 18:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_d6a25d43aa7f9da45c5f58a3564cbf67.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_564ce31dbd288896fa57b209ecfc7d35.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:36 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-28 18:40:36 [auto1.de] INFO: Scrape type for RU06209: 2
2026-03-28 18:40:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d99e518-32d2-54f7-8214-843c927807e6 with identifier: RU06209
2026-03-28 18:40:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d99e518-32d2-54f7-8214-843c927807e6 with scrape type 2
2026-03-28 18:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d99e518-32d2-54f7-8214-843c927807e6 with scrape type 2
2026-03-28 18:40:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d99e518-32d2-54f7-8214-843c927807e6, identifier: RU06209
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_7617975deb279b95839bc1e6ef7833aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_7617975deb279b95839bc1e6ef7833aa.jpg not downloaded yet
2026-03-28 18:40:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d99e518-32d2-54f7-8214-843c927807e6 with identifier: RU06209
2026-03-28 18:40:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d99e518-32d2-54f7-8214-843c927807e6 with identifier: RU06209
2026-03-28 18:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d99e518-32d2-54f7-8214-843c927807e6 with identifier: RU06209 to the API
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:28:28Z',
 'fuel_type': 'petrol',
 'id': '3d99e518-32d2-54f7-8214-843c927807e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU06209',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 171976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2010}
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU06209%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Saving data for RU06209: {'auction_closing_time': 1774884508.0, 'created_time': 1774118439.748529, 'last_price_update_time': 1774723237.247461}
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU06209') HTTP/1.1" 204 0
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb32b10>
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_ad237a95e153e5c31796ee6cf43f7f18.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_ad237a95e153e5c31796ee6cf43f7f18.jpg saved to cache
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b192d50>
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_f08fe392efa62cfe5f512c2fbf6857aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_f08fe392efa62cfe5f512c2fbf6857aa.jpg saved to cache
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb61a90>
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_8f103947f1972261ec30539ca7d98f1e.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_8f103947f1972261ec30539ca7d98f1e.jpg saved to cache
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd09450>
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_97c4e9704d0bd18608e61de0856215d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_97c4e9704d0bd18608e61de0856215d8.jpg saved to cache
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_2b28d08dd505cbd38ccf1b4422399b95.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_ba19b9fc3d89a1b81fc5d48d885bdfc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-28 18:40:37 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Scrape type for CN30644: 2
2026-03-28 18:40:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec55ff04-986b-5e4a-94b6-108635ae56f5 with identifier: CN30644
2026-03-28 18:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec55ff04-986b-5e4a-94b6-108635ae56f5 with scrape type 2
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec55ff04-986b-5e4a-94b6-108635ae56f5 with scrape type 2
2026-03-28 18:40:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec55ff04-986b-5e4a-94b6-108635ae56f5, identifier: CN30644
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_a50843327a9d0957ccda8d06cc0383c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_a50843327a9d0957ccda8d06cc0383c7.jpg not downloaded yet
2026-03-28 18:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0aae372031e36ae6cf9b9275c3c0439a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec55ff04-986b-5e4a-94b6-108635ae56f5 with identifier: CN30644
2026-03-28 18:40:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec55ff04-986b-5e4a-94b6-108635ae56f5 with identifier: CN30644
2026-03-28 18:40:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec55ff04-986b-5e4a-94b6-108635ae56f5 with identifier: CN30644 to the API
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:33:00Z',
 'fuel_type': 'petrol',
 'id': 'ec55ff04-986b-5e4a-94b6-108635ae56f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN30644',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 195092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-09',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN30644%27 HTTP/1.1" 200 None
2026-03-28 18:40:37 [auto1.de] INFO: Saving data for CN30644: {'auction_closing_time': 1774884780.0, 'created_time': 1774349002.792702, 'last_price_update_time': 1774723237.885825}
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN30644') HTTP/1.1" 204 0
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b104990>
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg93%252F96%252F9396cf7f696550a4f9b088d5d9b1e063%252Fpa%252FSZ07968_d6a25d43aa7f9da45c5f58a3564cbf67.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_d6a25d43aa7f9da45c5f58a3564cbf67.jpg saved to cache
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71d3247a-6966-5772-a47d-7b7133156e5a
2026-03-28 18:40:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71d3247a-6966-5772-a47d-7b7133156e5a, skipping ID generation
2026-03-28 18:40:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71d3247a-6966-5772-a47d-7b7133156e5a with scrape type 1
2026-03-28 18:40:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71d3247a-6966-5772-a47d-7b7133156e5a sending to next pipeline
2026-03-28 18:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71d3247a-6966-5772-a47d-7b7133156e5a, identifier: SZ07968
2026-03-28 18:40:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc02190>
2026-03-28 18:40:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_564ce31dbd288896fa57b209ecfc7d35.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_564ce31dbd288896fa57b209ecfc7d35.jpg saved to cache
2026-03-28 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_b649e22af0d5dcac950fec4bf18fce67.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Scrape type for PC42361: 2
2026-03-28 18:40:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 427b8ddd-0248-5690-ae33-5af20c306874 with identifier: PC42361
2026-03-28 18:40:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 427b8ddd-0248-5690-ae33-5af20c306874 with scrape type 2
2026-03-28 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 427b8ddd-0248-5690-ae33-5af20c306874 with scrape type 2
2026-03-28 18:40:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 427b8ddd-0248-5690-ae33-5af20c306874, identifier: PC42361
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_8d53243309333c25dc320be68b2917e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_8d53243309333c25dc320be68b2917e6.jpg not downloaded yet
2026-03-28 18:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71d3247a-6966-5772-a47d-7b7133156e5a with identifier: SZ07968
2026-03-28 18:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71d3247a-6966-5772-a47d-7b7133156e5a with identifier: SZ07968
2026-03-28 18:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71d3247a-6966-5772-a47d-7b7133156e5a with identifier: SZ07968 to the API
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_d6a25d43aa7f9da45c5f58a3564cbf67.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:30:53Z',
 'fuel_type': 'petrol',
 'id': '71d3247a-6966-5772-a47d-7b7133156e5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ07968',
 'listing': 'auction',
 'location': 'DE, Hof',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 63431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_d6a25d43aa7f9da45c5f58a3564cbf67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_8f103947f1972261ec30539ca7d98f1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51093,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_b318f38b80f508cb32319802814e70a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57227,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_8bf2bafb0bf8e468e2ae7ea107e76ef2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_eb62a34f612691893584503404afe993.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_38a2acfc406f4445d18644fb67db7b72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_f08fe392efa62cfe5f512c2fbf6857aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_a769aa7c4909bb301cc23e353ffe7f6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_9613d408d81300015d1ba0df9f537326.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71d3247a-6966-5772-a47d-7b7133156e5a/71d3247a-6966-5772-a47d-7b7133156e5a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78186,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img93/96/9396cf7f696550a4f9b088d5d9b1e063/pa/SZ07968_236c20e0b64df24b2e05505c06acb809.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ07968%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Saving data for SZ07968: {'created_time': 1774723238.571464, 'last_price_update_time': 1774723238.571478, 'auction_closing_time': 1774884653.0}
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ07968') HTTP/1.1" 204 0
2026-03-28 18:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_8ab31a96dcf95621b374bbda7b578771.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 427b8ddd-0248-5690-ae33-5af20c306874 with identifier: PC42361
2026-03-28 18:40:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 427b8ddd-0248-5690-ae33-5af20c306874 with identifier: PC42361
2026-03-28 18:40:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 427b8ddd-0248-5690-ae33-5af20c306874 with identifier: PC42361 to the API
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'petrol',
 'id': '427b8ddd-0248-5690-ae33-5af20c306874',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC42361',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 137972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-09',
 'seller_name': None,
 'title': 'Kia Venga 1.6 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2013}
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC42361%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Saving data for PC42361: {'auction_closing_time': 1774884844.0, 'created_time': 1773467153.59693, 'last_price_update_time': 1774723238.941162}
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC42361') HTTP/1.1" 204 0
2026-03-28 18:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV82977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_3e556541061947bd90159b3497a021b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:38 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [auto1.de] INFO: Scrape type for ZD03679: 1
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_5cf79e443a1805b7ec5503ad3860818a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_5cf79e443a1805b7ec5503ad3860818a.jpg not downloaded yet
2026-03-28 18:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS29828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc23150>
2026-03-28 18:40:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_2b28d08dd505cbd38ccf1b4422399b95.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_2b28d08dd505cbd38ccf1b4422399b95.jpg saved to cache
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb2e50>
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_ba19b9fc3d89a1b81fc5d48d885bdfc1.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_ba19b9fc3d89a1b81fc5d48d885bdfc1.jpg saved to cache
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:40:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc01210>
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2c%252F59%252F2c59828d6e4bf177c9b8b2eb47c5e6f3%252Fpa%252FGE75594_0aae372031e36ae6cf9b9275c3c0439a.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0aae372031e36ae6cf9b9275c3c0439a.jpg saved to cache
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 617edb04-356d-5359-8573-64b9d3cb0609
2026-03-28 18:40:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 617edb04-356d-5359-8573-64b9d3cb0609, skipping ID generation
2026-03-28 18:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 617edb04-356d-5359-8573-64b9d3cb0609 with scrape type 1
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 617edb04-356d-5359-8573-64b9d3cb0609 sending to next pipeline
2026-03-28 18:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 617edb04-356d-5359-8573-64b9d3cb0609, identifier: GE75594
2026-03-28 18:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_7617975deb279b95839bc1e6ef7833aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 617edb04-356d-5359-8573-64b9d3cb0609 with identifier: GE75594
2026-03-28 18:40:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 617edb04-356d-5359-8573-64b9d3cb0609 with identifier: GE75594
2026-03-28 18:40:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 617edb04-356d-5359-8573-64b9d3cb0609 with identifier: GE75594 to the API
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0aae372031e36ae6cf9b9275c3c0439a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:10:28Z',
 'fuel_type': 'diesel',
 'id': '617edb04-356d-5359-8573-64b9d3cb0609',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE75594',
 'listing': 'auction',
 'location': 'DE, Laatzen',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 139797,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0aae372031e36ae6cf9b9275c3c0439a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69470,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_164deae6c1e47643267c716f8aca0788.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2915656,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_cf3a9c5725ad398635ae409722de8769.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_0516cb63de00b94b127a924d730a3f5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2992414,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_64bc871bfd75f5a3df14769dacd45055.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2831962,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_629b50d8a40ae575c2f87f7b1a9f772d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538987,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_c199e32d900bc32ee04d52a1c1edac03.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_a005986327a5391d8198f2146f46e515.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_125955b14e0f42e27f5707bc7697ea92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_617edb04-356d-5359-8573-64b9d3cb0609/617edb04-356d-5359-8573-64b9d3cb0609_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3258765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2c/59/2c59828d6e4bf177c9b8b2eb47c5e6f3/pa/GE75594_c7b9b69c1ae32ab047de4bc621e6b00f.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Grand C-Max 2.0 TDCi Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2016}
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE75594%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Saving data for GE75594: {'created_time': 1774723239.788042, 'last_price_update_time': 1774723239.788055, 'auction_closing_time': 1774883428.0}
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE75594') HTTP/1.1" 204 0
2026-03-28 18:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_03b4551577d2bc8a4717dc287c9c47a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:39 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [auto1.de] INFO: Scrape type for AJ68338: 2
2026-03-28 18:40:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with identifier: AJ68338
2026-03-28 18:40:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with scrape type 2
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with scrape type 2
2026-03-28 18:40:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a0e53df-9864-56d9-afa2-2a8740ea3d36, identifier: AJ68338
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_e5892197613a799c0ddc88cdd24611af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_e5892197613a799c0ddc88cdd24611af.jpg not downloaded yet
2026-03-28 18:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW24707/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV11386/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb1810>
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_b649e22af0d5dcac950fec4bf18fce67.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_b649e22af0d5dcac950fec4bf18fce67.jpg saved to cache
2026-03-28 18:40:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb06d10>
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_8ab31a96dcf95621b374bbda7b578771.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_8ab31a96dcf95621b374bbda7b578771.jpg saved to cache
2026-03-28 18:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with identifier: AJ68338
2026-03-28 18:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with identifier: AJ68338
2026-03-28 18:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a0e53df-9864-56d9-afa2-2a8740ea3d36 with identifier: AJ68338 to the API
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:57:26Z',
 'fuel_type': 'diesel',
 'id': '8a0e53df-9864-56d9-afa2-2a8740ea3d36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ68338',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 228832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2015}
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ68338%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Saving data for AJ68338: {'auction_closing_time': 1774886246.0, 'created_time': 1774349240.409744, 'last_price_update_time': 1774723240.352876}
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ68338') HTTP/1.1" 204 0
2026-03-28 18:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:40 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-28 18:40:40 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Scrape type for XY91311: 2
2026-03-28 18:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f84baffb-0e13-5ad0-a1a4-2ef597649472 with identifier: XY91311
2026-03-28 18:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f84baffb-0e13-5ad0-a1a4-2ef597649472 with scrape type 2
2026-03-28 18:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f84baffb-0e13-5ad0-a1a4-2ef597649472 with scrape type 2
2026-03-28 18:40:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f84baffb-0e13-5ad0-a1a4-2ef597649472, identifier: XY91311
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_b6fa672ae4b7f4bd622d6036ec9f7b95.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_b6fa672ae4b7f4bd622d6036ec9f7b95.jpg not downloaded yet
2026-03-28 18:40:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f84baffb-0e13-5ad0-a1a4-2ef597649472 with identifier: XY91311
2026-03-28 18:40:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f84baffb-0e13-5ad0-a1a4-2ef597649472 with identifier: XY91311
2026-03-28 18:40:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f84baffb-0e13-5ad0-a1a4-2ef597649472 with identifier: XY91311 to the API
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:41:54Z',
 'fuel_type': 'petrol',
 'id': 'f84baffb-0e13-5ad0-a1a4-2ef597649472',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY91311',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 127668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91311%27 HTTP/1.1" 200 None
2026-03-28 18:40:40 [auto1.de] INFO: Saving data for XY91311: {'auction_closing_time': 1774885314.0, 'created_time': 1773466972.307928, 'last_price_update_time': 1774723240.869648}
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY91311') HTTP/1.1" 204 0
2026-03-28 18:40:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be71e50>
2026-03-28 18:40:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_3e556541061947bd90159b3497a021b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_3e556541061947bd90159b3497a021b2.jpg saved to cache
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd98e50>
2026-03-28 18:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_7617975deb279b95839bc1e6ef7833aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_7617975deb279b95839bc1e6ef7833aa.jpg saved to cache
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ca9490>
2026-03-28 18:40:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_03b4551577d2bc8a4717dc287c9c47a2.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_03b4551577d2bc8a4717dc287c9c47a2.jpg saved to cache
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for UJ32060: 2
2026-03-28 18:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cff3e59-06db-5597-95ba-c222955270a2 with identifier: UJ32060
2026-03-28 18:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cff3e59-06db-5597-95ba-c222955270a2 with scrape type 2
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cff3e59-06db-5597-95ba-c222955270a2 with scrape type 2
2026-03-28 18:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cff3e59-06db-5597-95ba-c222955270a2, identifier: UJ32060
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_108874c041bef47ca52a027418c6392f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_108874c041bef47ca52a027418c6392f.jpg not downloaded yet
2026-03-28 18:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cff3e59-06db-5597-95ba-c222955270a2 with identifier: UJ32060
2026-03-28 18:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cff3e59-06db-5597-95ba-c222955270a2 with identifier: UJ32060
2026-03-28 18:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cff3e59-06db-5597-95ba-c222955270a2 with identifier: UJ32060 to the API
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:58:31Z',
 'fuel_type': 'diesel',
 'id': '3cff3e59-06db-5597-95ba-c222955270a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ32060',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Range Rover Velar',
 'odometer': 42357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-03',
 'seller_name': None,
 'title': 'Land Rover Range Rover Velar 3.0 V6 Diesel S',
 'transmission': 'automatic',
 'trim': 'S',
 'year': 2019}
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ32060%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Saving data for UJ32060: {'auction_closing_time': 1774886311.0, 'created_time': 1774350144.259673, 'last_price_update_time': 1774723241.669548}
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ32060') HTTP/1.1" 204 0
2026-03-28 18:40:41 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for VX51529: 1
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_6a3fea26defdf9284229927d3d4957ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_6a3fea26defdf9284229927d3d4957ae.jpg not downloaded yet
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for FK87134: 2
2026-03-28 18:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44a8044f-c450-5be3-b500-3bc4536b884f with identifier: FK87134
2026-03-28 18:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44a8044f-c450-5be3-b500-3bc4536b884f with scrape type 2
2026-03-28 18:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44a8044f-c450-5be3-b500-3bc4536b884f with scrape type 2
2026-03-28 18:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44a8044f-c450-5be3-b500-3bc4536b884f, identifier: FK87134
2026-03-28 18:40:41 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-28 18:40:41 [auto1.de] INFO: Scrape type for ZX35580: 1
2026-03-28 18:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44a8044f-c450-5be3-b500-3bc4536b884f with identifier: FK87134
2026-03-28 18:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44a8044f-c450-5be3-b500-3bc4536b884f with identifier: FK87134
2026-03-28 18:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44a8044f-c450-5be3-b500-3bc4536b884f with identifier: FK87134 to the API
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:20:47Z',
 'fuel_type': 'diesel',
 'id': '44a8044f-c450-5be3-b500-3bc4536b884f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK87134',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo Life',
 'odometer': 178645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-26',
 'seller_name': None,
 'title': 'Opel Combo Life 1.5 CDTI INNOVATION',
 'transmission': 'manual',
 'trim': 'INNOVATION',
 'year': 2019}
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK87134%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Saving data for FK87134: {'auction_closing_time': 1774884047.0, 'created_time': 1773467508.568938, 'last_price_update_time': 1774723242.249704}
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK87134') HTTP/1.1" 204 0
2026-03-28 18:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE29415/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_a50843327a9d0957ccda8d06cc0383c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_5cf79e443a1805b7ec5503ad3860818a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for AC64408: 1
2026-03-28 18:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_e5892197613a799c0ddc88cdd24611af.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_8d53243309333c25dc320be68b2917e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_b6fa672ae4b7f4bd622d6036ec9f7b95.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for MB10012: 2
2026-03-28 18:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with identifier: MB10012
2026-03-28 18:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with scrape type 2
2026-03-28 18:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with scrape type 2
2026-03-28 18:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75, identifier: MB10012
2026-03-28 18:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with identifier: MB10012
2026-03-28 18:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with identifier: MB10012
2026-03-28 18:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 923d59ba-f624-5d17-b8e7-2e2dbbb44a75 with identifier: MB10012 to the API
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:00:44Z',
 'fuel_type': 'petrol',
 'id': '923d59ba-f624-5d17-b8e7-2e2dbbb44a75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB10012',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 27610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-30',
 'seller_name': None,
 'title': 'BMW 1er M135i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2022}
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB10012%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Saving data for MB10012: {'auction_closing_time': 1774882844.0, 'created_time': 1774350115.697237, 'last_price_update_time': 1774723242.853706}
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB10012') HTTP/1.1" 204 0
2026-03-28 18:40:42 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-28 18:40:42 [auto1.de] INFO: Scrape type for MS92853: 2
2026-03-28 18:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with identifier: MS92853
2026-03-28 18:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with scrape type 2
2026-03-28 18:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with scrape type 2
2026-03-28 18:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f, identifier: MS92853
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Scrape type for JB16135: 1
2026-03-28 18:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with identifier: MS92853
2026-03-28 18:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with identifier: MS92853
2026-03-28 18:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1aead1ca-720d-54ed-b4db-ab60e2e65f0f with identifier: MS92853 to the API
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:12:07Z',
 'fuel_type': 'diesel',
 'id': '1aead1ca-720d-54ed-b4db-ab60e2e65f0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS92853',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 173540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-03',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2016}
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS92853%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Saving data for MS92853: {'auction_closing_time': 1774883527.0, 'created_time': 1773304455.240492, 'last_price_update_time': 1774723243.429072}
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS92853') HTTP/1.1" 204 0
2026-03-28 18:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_8bde6a1728b48166956c3d17f67a97ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Scrape type for KJ96076: 1
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd09fd0>
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_a50843327a9d0957ccda8d06cc0383c7.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_a50843327a9d0957ccda8d06cc0383c7.jpg saved to cache
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc1de10>
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_5cf79e443a1805b7ec5503ad3860818a.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_5cf79e443a1805b7ec5503ad3860818a.jpg saved to cache
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26f5d0>
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_e5892197613a799c0ddc88cdd24611af.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_e5892197613a799c0ddc88cdd24611af.jpg saved to cache
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc1eb10>
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_8d53243309333c25dc320be68b2917e6.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_8d53243309333c25dc320be68b2917e6.jpg saved to cache
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc32f10>
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_b6fa672ae4b7f4bd622d6036ec9f7b95.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_b6fa672ae4b7f4bd622d6036ec9f7b95.jpg saved to cache
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_3c607a15974126a6ff1b101b75829aaf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_1633ac50cde5e0e68f4df091d4680d47.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_217de3db719839ec3fe872ab9a55f952.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:43 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-28 18:40:43 [auto1.de] INFO: Scrape type for WX88880: 2
2026-03-28 18:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with identifier: WX88880
2026-03-28 18:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with scrape type 2
2026-03-28 18:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with scrape type 2
2026-03-28 18:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f, identifier: WX88880
2026-03-28 18:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with identifier: WX88880
2026-03-28 18:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with identifier: WX88880
2026-03-28 18:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3ec38590-92b7-5435-b8dc-b8ab11c2b44f with identifier: WX88880 to the API
2026-03-28 18:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:56:13Z',
 'fuel_type': 'petrol',
 'id': '3ec38590-92b7-5435-b8dc-b8ab11c2b44f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX88880',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 50296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-17',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2019}
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX88880%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Saving data for WX88880: {'auction_closing_time': 1774886173.0, 'created_time': 1774089033.370914, 'last_price_update_time': 1774723244.215887}
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX88880') HTTP/1.1" 204 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: US66744
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for US66744: 1
2026-03-28 18:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_6a3fea26defdf9284229927d3d4957ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for AL99999: 2
2026-03-28 18:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6553baf9-39df-598f-a999-25315b750b72 with identifier: AL99999
2026-03-28 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6553baf9-39df-598f-a999-25315b750b72 with scrape type 2
2026-03-28 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6553baf9-39df-598f-a999-25315b750b72 with scrape type 2
2026-03-28 18:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6553baf9-39df-598f-a999-25315b750b72, identifier: AL99999
2026-03-28 18:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd48c50>
2026-03-28 18:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_8bde6a1728b48166956c3d17f67a97ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_8bde6a1728b48166956c3d17f67a97ca.jpg saved to cache
2026-03-28 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6553baf9-39df-598f-a999-25315b750b72 with identifier: AL99999
2026-03-28 18:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6553baf9-39df-598f-a999-25315b750b72 with identifier: AL99999
2026-03-28 18:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6553baf9-39df-598f-a999-25315b750b72 with identifier: AL99999 to the API
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:45:27Z',
 'fuel_type': 'diesel',
 'id': '6553baf9-39df-598f-a999-25315b750b72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL99999',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 148161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-26',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CDI BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL99999%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Saving data for AL99999: {'auction_closing_time': 1774885527.0, 'created_time': 1774032300.394935, 'last_price_update_time': 1774723244.736667}
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL99999') HTTP/1.1" 204 0
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for GB90564: 1
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-28 18:40:44 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-28 18:40:44 [auto1.de] INFO: Scrape type for LD20816: 2
2026-03-28 18:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4858f21e-76f8-5236-8fa2-264c178f1b59 with identifier: LD20816
2026-03-28 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4858f21e-76f8-5236-8fa2-264c178f1b59 with scrape type 2
2026-03-28 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4858f21e-76f8-5236-8fa2-264c178f1b59 with scrape type 2
2026-03-28 18:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4858f21e-76f8-5236-8fa2-264c178f1b59, identifier: LD20816
2026-03-28 18:40:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZD03679/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b189e10>
2026-03-28 18:40:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252Fb6%252F85b64016b276c49ffa5d969d01a9183b%252Fpa%252FBM68891_3c607a15974126a6ff1b101b75829aaf.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_3c607a15974126a6ff1b101b75829aaf.jpg saved to cache
2026-03-28 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3c28e30-faf7-55b7-b813-db14b82311a8
2026-03-28 18:40:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3c28e30-faf7-55b7-b813-db14b82311a8, skipping ID generation
2026-03-28 18:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3c28e30-faf7-55b7-b813-db14b82311a8 with scrape type 1
2026-03-28 18:40:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3c28e30-faf7-55b7-b813-db14b82311a8 sending to next pipeline
2026-03-28 18:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3c28e30-faf7-55b7-b813-db14b82311a8, identifier: BM68891
2026-03-28 18:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be80150>
2026-03-28 18:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_1633ac50cde5e0e68f4df091d4680d47.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_1633ac50cde5e0e68f4df091d4680d47.jpg saved to cache
2026-03-28 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb94dd0>
2026-03-28 18:40:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_217de3db719839ec3fe872ab9a55f952.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_217de3db719839ec3fe872ab9a55f952.jpg saved to cache
2026-03-28 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_108874c041bef47ca52a027418c6392f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4858f21e-76f8-5236-8fa2-264c178f1b59 with identifier: LD20816
2026-03-28 18:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4858f21e-76f8-5236-8fa2-264c178f1b59 with identifier: LD20816
2026-03-28 18:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4858f21e-76f8-5236-8fa2-264c178f1b59 with identifier: LD20816 to the API
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:41:28Z',
 'fuel_type': 'diesel',
 'id': '4858f21e-76f8-5236-8fa2-264c178f1b59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD20816',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 124367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-04',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD20816%27 HTTP/1.1" 200 None
2026-03-28 18:40:45 [auto1.de] INFO: Saving data for LD20816: {'auction_closing_time': 1774885288.0, 'created_time': 1774349727.604184, 'last_price_update_time': 1774723245.430494}
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD20816') HTTP/1.1" 204 0
2026-03-28 18:40:45 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-28 18:40:45 [auto1.de] INFO: Scrape type for RL85498: 2
2026-03-28 18:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with identifier: RL85498
2026-03-28 18:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with scrape type 2
2026-03-28 18:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with scrape type 2
2026-03-28 18:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52, identifier: RL85498
2026-03-28 18:40:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3c28e30-faf7-55b7-b813-db14b82311a8 with identifier: BM68891
2026-03-28 18:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3c28e30-faf7-55b7-b813-db14b82311a8 with identifier: BM68891
2026-03-28 18:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3c28e30-faf7-55b7-b813-db14b82311a8 with identifier: BM68891 to the API
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_3c607a15974126a6ff1b101b75829aaf.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:19:49Z',
 'fuel_type': 'petrol',
 'id': 'a3c28e30-faf7-55b7-b813-db14b82311a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM68891',
 'listing': 'auction',
 'location': 'DE, Geldern',
 'make': 'Mazda',
 'model': '3',
 'odometer': 145637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67880,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_aaf240d02a135f43f9a2c208f58a869f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_cf300d99ff23b045e254a215b9827e80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5b7c4503f909c430f0bca2ec2676cbcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5258ff96b0caf05b6b747e92237e6534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_3c607a15974126a6ff1b101b75829aaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63023,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_586a9aae838169ba7ceba38ea9cb8717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_5e5557f67dca66468b89362e9072c6c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_8bde6a1728b48166956c3d17f67a97ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_8ab31a96dcf95621b374bbda7b578771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3c28e30-faf7-55b7-b813-db14b82311a8/a3c28e30-faf7-55b7-b813-db14b82311a8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71481,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/b6/85b64016b276c49ffa5d969d01a9183b/pa/BM68891_44a7243c139d50420415b4b6a961efd8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 2.0 Nakama',
 'transmission': 'manual',
 'trim': 'Nakama',
 'year': 2016}
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM68891%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Saving data for BM68891: {'created_time': 1774723246.093138, 'last_price_update_time': 1774723246.093149, 'auction_closing_time': 1774883989.0}
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM68891') HTTP/1.1" 204 0
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Scrape type for FR59515: 2
2026-03-28 18:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with identifier: FR59515
2026-03-28 18:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with scrape type 2
2026-03-28 18:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with scrape type 2
2026-03-28 18:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972, identifier: FR59515
2026-03-28 18:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with identifier: RL85498
2026-03-28 18:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with identifier: RL85498
2026-03-28 18:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52 with identifier: RL85498 to the API
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:27:52Z',
 'fuel_type': 'diesel',
 'id': '311e3a3f-b6dd-5d7d-95aa-7d8dbb6d0b52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL85498',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 36995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL85498%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Saving data for RL85498: {'auction_closing_time': 1774884472.0, 'created_time': 1773305669.110521, 'last_price_update_time': 1774723246.563721}
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RL85498') HTTP/1.1" 204 0
2026-03-28 18:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with identifier: FR59515
2026-03-28 18:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with identifier: FR59515
2026-03-28 18:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972 with identifier: FR59515 to the API
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:11:19Z',
 'fuel_type': 'petrol',
 'id': '64b4aae7-9f1a-563b-a5f4-aa0f0f7e1972',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR59515',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 161601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-30',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Style+',
 'transmission': 'manual',
 'trim': 'Style+',
 'year': 2010}
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR59515%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Saving data for FR59515: {'auction_closing_time': 1774883479.0, 'created_time': 1773467026.638101, 'last_price_update_time': 1774723246.890565}
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR59515') HTTP/1.1" 204 0
2026-03-28 18:40:46 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-28 18:40:46 [auto1.de] INFO: Scrape type for NV50024: 2
2026-03-28 18:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad57ac34-49c5-5baf-b713-35976aedf3fd with identifier: NV50024
2026-03-28 18:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad57ac34-49c5-5baf-b713-35976aedf3fd with scrape type 2
2026-03-28 18:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad57ac34-49c5-5baf-b713-35976aedf3fd with scrape type 2
2026-03-28 18:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad57ac34-49c5-5baf-b713-35976aedf3fd, identifier: NV50024
2026-03-28 18:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bba9250>
2026-03-28 18:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_6a3fea26defdf9284229927d3d4957ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_6a3fea26defdf9284229927d3d4957ae.jpg saved to cache
2026-03-28 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_05a7e536f9b2559c201f3966e5e95e06.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for PB68045: 1
2026-03-28 18:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad57ac34-49c5-5baf-b713-35976aedf3fd with identifier: NV50024
2026-03-28 18:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad57ac34-49c5-5baf-b713-35976aedf3fd with identifier: NV50024
2026-03-28 18:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad57ac34-49c5-5baf-b713-35976aedf3fd with identifier: NV50024 to the API
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:04:34Z',
 'fuel_type': 'petrol',
 'id': 'ad57ac34-49c5-5baf-b713-35976aedf3fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV50024',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 110706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-14',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2016}
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV50024%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Saving data for NV50024: {'auction_closing_time': 1774883074.0, 'created_time': 1773400786.742512, 'last_price_update_time': 1774723247.405011}
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV50024') HTTP/1.1" 204 0
2026-03-28 18:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV11386> (referer: https://www.auto1.com/v1/car-details-view/ZV11386/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW24707> (referer: https://www.auto1.com/v1/car-details-view/FW24707/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-28 18:40:47 [auto1.de] INFO: Scrape type for WB83413: 1
2026-03-28 18:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b055450>
2026-03-28 18:40:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg82%252Fad%252F82ad45e444a9ea30f7d49da2df09531d%252Fpa%252FYD79813_108874c041bef47ca52a027418c6392f.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_108874c041bef47ca52a027418c6392f.jpg saved to cache
2026-03-28 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2a508ed-99bf-546f-94d2-377440141fdc
2026-03-28 18:40:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2a508ed-99bf-546f-94d2-377440141fdc, skipping ID generation
2026-03-28 18:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2a508ed-99bf-546f-94d2-377440141fdc with scrape type 1
2026-03-28 18:40:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2a508ed-99bf-546f-94d2-377440141fdc sending to next pipeline
2026-03-28 18:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2a508ed-99bf-546f-94d2-377440141fdc, identifier: YD79813
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-28 18:40:47 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-28 18:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2a508ed-99bf-546f-94d2-377440141fdc with identifier: YD79813
2026-03-28 18:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2a508ed-99bf-546f-94d2-377440141fdc with identifier: YD79813
2026-03-28 18:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2a508ed-99bf-546f-94d2-377440141fdc with identifier: YD79813 to the API
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_108874c041bef47ca52a027418c6392f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:39:56Z',
 'fuel_type': 'diesel',
 'id': 'a2a508ed-99bf-546f-94d2-377440141fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD79813',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 134866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_b649e22af0d5dcac950fec4bf18fce67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_3e556541061947bd90159b3497a021b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_7617975deb279b95839bc1e6ef7833aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_a50843327a9d0957ccda8d06cc0383c7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_8d53243309333c25dc320be68b2917e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_5cf79e443a1805b7ec5503ad3860818a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_e5892197613a799c0ddc88cdd24611af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_b6fa672ae4b7f4bd622d6036ec9f7b95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_108874c041bef47ca52a027418c6392f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2a508ed-99bf-546f-94d2-377440141fdc/a2a508ed-99bf-546f-94d2-377440141fdc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img82/ad/82ad45e444a9ea30f7d49da2df09531d/pa/YD79813_6a3fea26defdf9284229927d3d4957ae.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-05-05',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Fiat Talento 1.6 TwinTurbo Diesel Ecojet L2H1 1,2t SX',
 'transmission': 'manual',
 'trim': 'L2H1 1,2t SX',
 'year': 2019}
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD79813%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Saving data for YD79813: {'created_time': 1774723253.027544, 'last_price_update_time': 1774723253.02758, 'auction_closing_time': 1774885196.0}
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD79813') HTTP/1.1" 204 0
2026-03-28 18:40:53 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Scrape type for NX27502: 2
2026-03-28 18:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3784b105-ba52-554a-b989-ed0fe0ec618f with identifier: NX27502
2026-03-28 18:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3784b105-ba52-554a-b989-ed0fe0ec618f with scrape type 2
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3784b105-ba52-554a-b989-ed0fe0ec618f with scrape type 2
2026-03-28 18:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3784b105-ba52-554a-b989-ed0fe0ec618f, identifier: NX27502
2026-03-28 18:40:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC64408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3784b105-ba52-554a-b989-ed0fe0ec618f with identifier: NX27502
2026-03-28 18:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3784b105-ba52-554a-b989-ed0fe0ec618f with identifier: NX27502
2026-03-28 18:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3784b105-ba52-554a-b989-ed0fe0ec618f with identifier: NX27502 to the API
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:02:51Z',
 'fuel_type': 'petrol',
 'id': '3784b105-ba52-554a-b989-ed0fe0ec618f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX27502',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 34473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-09',
 'seller_name': None,
 'title': 'BMW 2er 218i Gran Coupe Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2024}
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX27502%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [auto1.de] INFO: Saving data for NX27502: {'auction_closing_time': 1774882971.0, 'created_time': 1774034564.635158, 'last_price_update_time': 1774723253.489259}
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX27502') HTTP/1.1" 204 0
2026-03-28 18:40:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd5ba50>
2026-03-28 18:40:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_05a7e536f9b2559c201f3966e5e95e06.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_05a7e536f9b2559c201f3966e5e95e06.jpg saved to cache
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:53 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 6006 | hits on page: 40
2026-03-28 18:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b793bd-a69a-530d-b3eb-627cf50be2c4 with identifier: ZV11386
2026-03-28 18:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b793bd-a69a-530d-b3eb-627cf50be2c4 with scrape type 1
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7b793bd-a69a-530d-b3eb-627cf50be2c4
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_608dcaf6814720d208f08aea26d445d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_608dcaf6814720d208f08aea26d445d7.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_d3392a28d39569e275fd6da4c93ca415.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_d3392a28d39569e275fd6da4c93ca415.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_f8af83721b4728ad9b44e8b4a29edfcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_f8af83721b4728ad9b44e8b4a29edfcf.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_4e3efc77ec2007433f22b9f96ed929be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_4e3efc77ec2007433f22b9f96ed929be.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_57e6c4edb3faa21188610966e5203d1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_57e6c4edb3faa21188610966e5203d1c.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_beebd3fa6aea3382250691386867f3e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_beebd3fa6aea3382250691386867f3e3.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_5d553208cc7a685e1cf76c23414e434e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_5d553208cc7a685e1cf76c23414e434e.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_1a677fb6a8ac2db952ccb2d9d48d5c35.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_1a677fb6a8ac2db952ccb2d9d48d5c35.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_5716d6667abeda53c34b55cf238dd928.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_5716d6667abeda53c34b55cf238dd928.jpg already downloaded
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2a%252F34%252F2a3429f0e0b5116b4f607f3b893cc451%252Fpa%252FZV11386_4c86843f8555f8818e7d8a33d7f132cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_4c86843f8555f8818e7d8a33d7f132cb.jpg already downloaded
2026-03-28 18:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7b793bd-a69a-530d-b3eb-627cf50be2c4, identifier: ZV11386
2026-03-28 18:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6690f607-4957-555e-a051-306c79479799 with identifier: FW24707
2026-03-28 18:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6690f607-4957-555e-a051-306c79479799 with scrape type 1
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6690f607-4957-555e-a051-306c79479799
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_7adda7b0fcda82dfb59d6a614f777c21.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_7adda7b0fcda82dfb59d6a614f777c21.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_b7e78eeba48c6085a99fe1a6cd1c85d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_b7e78eeba48c6085a99fe1a6cd1c85d2.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_7d6c02c82486ed0850122f49f13ed342.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_7d6c02c82486ed0850122f49f13ed342.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_be9dc98a26413ab84b98d7bef9c4112c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_be9dc98a26413ab84b98d7bef9c4112c.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_2a9bcd86cd88000886e865b398003386.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_2a9bcd86cd88000886e865b398003386.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_f72e7d24b1b4b0a5fa82bdae254305a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_f72e7d24b1b4b0a5fa82bdae254305a1.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_56c7962041b7d416d8fa6b9969fd283a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_56c7962041b7d416d8fa6b9969fd283a.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_1c3332fe3bf2a7645e3b57cbc933c5d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_1c3332fe3bf2a7645e3b57cbc933c5d2.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_0c71f109b12236370e0fb9b9f8153a22.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_0c71f109b12236370e0fb9b9f8153a22.jpg already downloaded
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252Ff1%252F2bf1816b47209bbb1cb69b8b0186abcc%252Fpa%252FFW24707_e51dc8f22bb534e83f2a9858d8b025dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_e51dc8f22bb534e83f2a9858d8b025dd.jpg already downloaded
2026-03-28 18:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6690f607-4957-555e-a051-306c79479799, identifier: FW24707
2026-03-28 18:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_bb4dd147c3de4bb5643b386613ce6f11.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-28 18:40:54 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Scrape type for MF21991: 2
2026-03-28 18:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58702e34-07fc-559d-a68b-b3cf9e7817d9 with identifier: MF21991
2026-03-28 18:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58702e34-07fc-559d-a68b-b3cf9e7817d9 with scrape type 2
2026-03-28 18:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58702e34-07fc-559d-a68b-b3cf9e7817d9 with scrape type 2
2026-03-28 18:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58702e34-07fc-559d-a68b-b3cf9e7817d9, identifier: MF21991
2026-03-28 18:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS01468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX51529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7b793bd-a69a-530d-b3eb-627cf50be2c4 with identifier: ZV11386
2026-03-28 18:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7b793bd-a69a-530d-b3eb-627cf50be2c4 with identifier: ZV11386
2026-03-28 18:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7b793bd-a69a-530d-b3eb-627cf50be2c4 with identifier: ZV11386 to the API
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZV11386>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:38:19Z',
 'fuel_type': 'petrol',
 'id': 'c7b793bd-a69a-530d-b3eb-627cf50be2c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV11386',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 172931,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_608dcaf6814720d208f08aea26d445d7.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_d3392a28d39569e275fd6da4c93ca415.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_f8af83721b4728ad9b44e8b4a29edfcf.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_4e3efc77ec2007433f22b9f96ed929be.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_57e6c4edb3faa21188610966e5203d1c.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_beebd3fa6aea3382250691386867f3e3.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_5d553208cc7a685e1cf76c23414e434e.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_1a677fb6a8ac2db952ccb2d9d48d5c35.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_5716d6667abeda53c34b55cf238dd928.jpg',
                'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_4c86843f8555f8818e7d8a33d7f132cb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_608dcaf6814720d208f08aea26d445d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_d3392a28d39569e275fd6da4c93ca415.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_f8af83721b4728ad9b44e8b4a29edfcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65182,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_4e3efc77ec2007433f22b9f96ed929be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83996,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_57e6c4edb3faa21188610966e5203d1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_beebd3fa6aea3382250691386867f3e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_5d553208cc7a685e1cf76c23414e434e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79897,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_1a677fb6a8ac2db952ccb2d9d48d5c35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77677,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_5716d6667abeda53c34b55cf238dd928.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b793bd-a69a-530d-b3eb-627cf50be2c4/c7b793bd-a69a-530d-b3eb-627cf50be2c4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99948,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2a/34/2a3429f0e0b5116b4f607f3b893cc451/pa/ZV11386_4c86843f8555f8818e7d8a33d7f132cb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV11386%27 HTTP/1.1" 200 None
2026-03-28 18:40:54 [auto1.de] INFO: Saving data for ZV11386: {'created_time': 1774723254.744946, 'last_price_update_time': 1774723254.744957, 'auction_closing_time': 1774885099.0}
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV11386') HTTP/1.1" 204 0
2026-03-28 18:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6690f607-4957-555e-a051-306c79479799 with identifier: FW24707
2026-03-28 18:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6690f607-4957-555e-a051-306c79479799 with identifier: FW24707
2026-03-28 18:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6690f607-4957-555e-a051-306c79479799 with identifier: FW24707 to the API
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW24707>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:13:01Z',
 'fuel_type': 'petrol',
 'id': '6690f607-4957-555e-a051-306c79479799',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW24707',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 81934,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_7adda7b0fcda82dfb59d6a614f777c21.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_b7e78eeba48c6085a99fe1a6cd1c85d2.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_7d6c02c82486ed0850122f49f13ed342.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_be9dc98a26413ab84b98d7bef9c4112c.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_2a9bcd86cd88000886e865b398003386.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_f72e7d24b1b4b0a5fa82bdae254305a1.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_56c7962041b7d416d8fa6b9969fd283a.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_1c3332fe3bf2a7645e3b57cbc933c5d2.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_0c71f109b12236370e0fb9b9f8153a22.jpg',
                'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_e51dc8f22bb534e83f2a9858d8b025dd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_7adda7b0fcda82dfb59d6a614f777c21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_b7e78eeba48c6085a99fe1a6cd1c85d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_7d6c02c82486ed0850122f49f13ed342.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_be9dc98a26413ab84b98d7bef9c4112c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_2a9bcd86cd88000886e865b398003386.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 7146,
             'Height': 144,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_f72e7d24b1b4b0a5fa82bdae254305a1.jpg',
             'Width': 192},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65289,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_56c7962041b7d416d8fa6b9969fd283a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_1c3332fe3bf2a7645e3b57cbc933c5d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_0c71f109b12236370e0fb9b9f8153a22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6690f607-4957-555e-a051-306c79479799/6690f607-4957-555e-a051-306c79479799_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/f1/2bf1816b47209bbb1cb69b8b0186abcc/pa/FW24707_e51dc8f22bb534e83f2a9858d8b025dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2018}
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW24707%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Saving data for FW24707: {'created_time': 1774723255.082264, 'last_price_update_time': 1774723255.082275, 'auction_closing_time': 1774883581.0}
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW24707') HTTP/1.1" 204 0
2026-03-28 18:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58702e34-07fc-559d-a68b-b3cf9e7817d9 with identifier: MF21991
2026-03-28 18:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58702e34-07fc-559d-a68b-b3cf9e7817d9 with identifier: MF21991
2026-03-28 18:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58702e34-07fc-559d-a68b-b3cf9e7817d9 with identifier: MF21991 to the API
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:12:51Z',
 'fuel_type': 'petrol',
 'id': '58702e34-07fc-559d-a68b-b3cf9e7817d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF21991',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'EX',
 'odometer': 262680,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-14',
 'seller_name': None,
 'title': 'Infiniti EX 3.7 V6 EX37 GT',
 'transmission': 'automatic',
 'trim': '37 GT',
 'year': 2012}
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF21991%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Saving data for MF21991: {'auction_closing_time': 1774883571.0, 'created_time': 1773304304.026468, 'last_price_update_time': 1774723255.423166}
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF21991') HTTP/1.1" 204 0
2026-03-28 18:40:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Scrape type for YC95910: 1
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Scrape type for XR92513: 2
2026-03-28 18:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caac8930-4b5a-593c-bc72-4a39ce9f96ed with identifier: XR92513
2026-03-28 18:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caac8930-4b5a-593c-bc72-4a39ce9f96ed with scrape type 2
2026-03-28 18:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caac8930-4b5a-593c-bc72-4a39ce9f96ed with scrape type 2
2026-03-28 18:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: caac8930-4b5a-593c-bc72-4a39ce9f96ed, identifier: XR92513
2026-03-28 18:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: caac8930-4b5a-593c-bc72-4a39ce9f96ed with identifier: XR92513
2026-03-28 18:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: caac8930-4b5a-593c-bc72-4a39ce9f96ed with identifier: XR92513
2026-03-28 18:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: caac8930-4b5a-593c-bc72-4a39ce9f96ed with identifier: XR92513 to the API
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:43:43Z',
 'fuel_type': 'diesel',
 'id': 'caac8930-4b5a-593c-bc72-4a39ce9f96ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR92513',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 65337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seller_name': None,
 'title': 'Opel Movano 2.3 CDTI L3H2 3,5t',
 'transmission': 'manual',
 'trim': 'L3H2 3,5t',
 'year': 2021}
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR92513%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Saving data for XR92513: {'auction_closing_time': 1774885423.0, 'created_time': 1773134926.918747, 'last_price_update_time': 1774723255.885598}
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR92513') HTTP/1.1" 204 0
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-28 18:40:55 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-28 18:40:55 [auto1.de] INFO: Scrape type for HE47734: 1
2026-03-28 18:40:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB16135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b150110>
2026-03-28 18:40:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_bb4dd147c3de4bb5643b386613ce6f11.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_bb4dd147c3de4bb5643b386613ce6f11.jpg saved to cache
2026-03-28 18:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for GZ82101: 1
2026-03-28 18:40:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e24b77d9d29f490ab8d5c3043d221c17.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for JR52179: 1
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for FT59815: 2
2026-03-28 18:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5ef1ffc-092c-5034-b687-f99265407c08 with identifier: FT59815
2026-03-28 18:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5ef1ffc-092c-5034-b687-f99265407c08 with scrape type 2
2026-03-28 18:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5ef1ffc-092c-5034-b687-f99265407c08 with scrape type 2
2026-03-28 18:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5ef1ffc-092c-5034-b687-f99265407c08, identifier: FT59815
2026-03-28 18:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5ef1ffc-092c-5034-b687-f99265407c08 with identifier: FT59815
2026-03-28 18:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5ef1ffc-092c-5034-b687-f99265407c08 with identifier: FT59815
2026-03-28 18:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5ef1ffc-092c-5034-b687-f99265407c08 with identifier: FT59815 to the API
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:21:40Z',
 'fuel_type': 'diesel',
 'id': 'b5ef1ffc-092c-5034-b687-f99265407c08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT59815',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 211042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2014}
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT59815%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Saving data for FT59815: {'auction_closing_time': 1774884100.0, 'created_time': 1774034627.764817, 'last_price_update_time': 1774723256.481757}
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT59815') HTTP/1.1" 204 0
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for LD23223: 1
2026-03-28 18:40:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_7b3d3d26e895c351cbc38866f3b17295.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-28 18:40:56 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-28 18:40:56 [auto1.de] INFO: Scrape type for TN55271: 2
2026-03-28 18:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with identifier: TN55271
2026-03-28 18:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with scrape type 2
2026-03-28 18:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with scrape type 2
2026-03-28 18:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e, identifier: TN55271
2026-03-28 18:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with identifier: TN55271
2026-03-28 18:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with identifier: TN55271
2026-03-28 18:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e with identifier: TN55271 to the API
2026-03-28 18:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-30T15:48:13Z',
 'fuel_type': 'petrol',
 'id': '3619154c-7bef-5ee6-9bf0-91d1f0b4ec4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN55271',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S7 Sportback',
 'odometer': 165664,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-12',
 'seller_name': None,
 'title': 'Audi S7 Sportback 4.0 V8 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN55271%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Saving data for TN55271: {'auction_closing_time': 1774885693.0, 'created_time': 1774089348.39497, 'last_price_update_time': 1774723257.114195}
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN55271') HTTP/1.1" 204 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for LM31898: 1
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for ZA78506: 1
2026-03-28 18:40:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:40:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1dad0>
2026-03-28 18:40:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252F87%252Fdc874440529ffc79bae7804516ce1eb9%252Fpa%252FJB74543_e24b77d9d29f490ab8d5c3043d221c17.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e24b77d9d29f490ab8d5c3043d221c17.jpg saved to cache
2026-03-28 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862
2026-03-28 18:40:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb4f4302-d420-5fbc-aa8a-2f4d0105d862, skipping ID generation
2026-03-28 18:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with scrape type 1
2026-03-28 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb4f4302-d420-5fbc-aa8a-2f4d0105d862 sending to next pipeline
2026-03-28 18:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb4f4302-d420-5fbc-aa8a-2f4d0105d862, identifier: JB74543
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for HL01555: 1
2026-03-28 18:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with identifier: JB74543
2026-03-28 18:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with identifier: JB74543
2026-03-28 18:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb4f4302-d420-5fbc-aa8a-2f4d0105d862 with identifier: JB74543 to the API
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e24b77d9d29f490ab8d5c3043d221c17.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:03:18Z',
 'fuel_type': 'petrol',
 'id': 'bb4f4302-d420-5fbc-aa8a-2f4d0105d862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB74543',
 'listing': 'auction',
 'location': 'DE, Düren',
 'make': 'Mazda',
 'model': '3',
 'odometer': 106429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_333b073ab2888ed8f6795af032796875.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2282014,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e24b77d9d29f490ab8d5c3043d221c17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65435,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_b1b5a29e74c4da4a7ca1edfae4abdeea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_e5e346acdedbadef886f773ceb5bd21a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2268381,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_bb4dd147c3de4bb5643b386613ce6f11.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_97c4e9704d0bd18608e61de0856215d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_f7fcad66f24074d631c3146aa0d94ab7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2329614,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_05a7e536f9b2559c201f3966e5e95e06.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_c03aeb8483d8d9e64424e54444a97b38.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb4f4302-d420-5fbc-aa8a-2f4d0105d862/bb4f4302-d420-5fbc-aa8a-2f4d0105d862_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/87/dc874440529ffc79bae7804516ce1eb9/pa/JB74543_ad237a95e153e5c31796ee6cf43f7f18.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2015}
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB74543%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Saving data for JB74543: {'created_time': 1774723257.74799, 'last_price_update_time': 1774723257.748002, 'auction_closing_time': 1774882998.0}
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB74543') HTTP/1.1" 204 0
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for GF23268: 1
2026-03-28 18:40:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US66744/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for WJ67055: 1
2026-03-28 18:40:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:40:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc237d0>
2026-03-28 18:40:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:40:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga9%252F97%252Fa9970c416742c68af4a2abbefeab0909%252Fpa%252FZH67756_7b3d3d26e895c351cbc38866f3b17295.jpg') HTTP/1.1" 204 0
2026-03-28 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_7b3d3d26e895c351cbc38866f3b17295.jpg saved to cache
2026-03-28 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685
2026-03-28 18:40:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54125cbd-1a1a-51e8-9047-2b9ff5abd685, skipping ID generation
2026-03-28 18:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with scrape type 1
2026-03-28 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54125cbd-1a1a-51e8-9047-2b9ff5abd685 sending to next pipeline
2026-03-28 18:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54125cbd-1a1a-51e8-9047-2b9ff5abd685, identifier: ZH67756
2026-03-28 18:40:57 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-28 18:40:57 [auto1.de] INFO: Scrape type for XT20747: 2
2026-03-28 18:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with identifier: XT20747
2026-03-28 18:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with scrape type 2
2026-03-28 18:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with scrape type 2
2026-03-28 18:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3, identifier: XT20747
2026-03-28 18:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with identifier: ZH67756
2026-03-28 18:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with identifier: ZH67756
2026-03-28 18:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54125cbd-1a1a-51e8-9047-2b9ff5abd685 with identifier: ZH67756 to the API
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_7b3d3d26e895c351cbc38866f3b17295.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:15:55Z',
 'fuel_type': 'diesel',
 'id': '54125cbd-1a1a-51e8-9047-2b9ff5abd685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH67756',
 'listing': 'auction',
 'location': 'DE, Hannover',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 230044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_7b3d3d26e895c351cbc38866f3b17295.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_1633ac50cde5e0e68f4df091d4680d47.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76393,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_217de3db719839ec3fe872ab9a55f952.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2940499,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_03b4551577d2bc8a4717dc287c9c47a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_5615cc164b2cafd5ab0b8d66cd0908f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73105,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_0fbfdc27e15f44a620e94a19436f705e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65143,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_37d09a9f43d250494a5bd80cdda7414f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72347,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_ca93d5a52483c75d343e4f8dfb8cd071.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74644,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_586a6f66bbf4da173ff69f22320eaea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54125cbd-1a1a-51e8-9047-2b9ff5abd685/54125cbd-1a1a-51e8-9047-2b9ff5abd685_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga9/97/a9970c416742c68af4a2abbefeab0909/pa/ZH67756_0a839fadc50d9a50c13b8a973fa8213f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Captur 1.5 dCi Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH67756%27 HTTP/1.1" 200 None
2026-03-28 18:40:58 [auto1.de] INFO: Saving data for ZH67756: {'created_time': 1774723258.479898, 'last_price_update_time': 1774723258.479909, 'auction_closing_time': 1774883755.0}
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH67756') HTTP/1.1" 204 0
2026-03-28 18:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with identifier: XT20747
2026-03-28 18:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with identifier: XT20747
2026-03-28 18:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c084f4cf-3fcf-5b95-bcfe-b7f558015fd3 with identifier: XT20747 to the API
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:49:55Z',
 'fuel_type': 'diesel',
 'id': 'c084f4cf-3fcf-5b95-bcfe-b7f558015fd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT20747',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 370005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-31',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT20747%27 HTTP/1.1" 200 None
2026-03-28 18:40:58 [auto1.de] INFO: Saving data for XT20747: {'auction_closing_time': 1774885795.0, 'created_time': 1773401356.18216, 'last_price_update_time': 1774723258.879104}
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT20747') HTTP/1.1" 204 0
2026-03-28 18:40:58 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-28 18:40:58 [auto1.de] INFO: Scrape type for EJ09183: 2
2026-03-28 18:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cef2007-155b-5ccf-a578-5b1b8bf9911f with identifier: EJ09183
2026-03-28 18:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cef2007-155b-5ccf-a578-5b1b8bf9911f with scrape type 2
2026-03-28 18:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1cef2007-155b-5ccf-a578-5b1b8bf9911f with scrape type 2
2026-03-28 18:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cef2007-155b-5ccf-a578-5b1b8bf9911f, identifier: EJ09183
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Scrape type for YD01023: 1
2026-03-28 18:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cef2007-155b-5ccf-a578-5b1b8bf9911f with identifier: EJ09183
2026-03-28 18:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cef2007-155b-5ccf-a578-5b1b8bf9911f with identifier: EJ09183
2026-03-28 18:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cef2007-155b-5ccf-a578-5b1b8bf9911f with identifier: EJ09183 to the API
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:14:00Z',
 'fuel_type': 'petrol',
 'id': '1cef2007-155b-5ccf-a578-5b1b8bf9911f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ09183',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Alto',
 'odometer': 136442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-11',
 'seller_name': None,
 'title': 'Suzuki Alto 1.0 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2012}
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ09183%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Saving data for EJ09183: {'auction_closing_time': 1774883640.0, 'created_time': 1773399540.483594, 'last_price_update_time': 1774723259.352092}
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ09183') HTTP/1.1" 204 0
2026-03-28 18:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZD03679> (referer: https://www.auto1.com/v1/car-details-view/ZD03679/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NE29415> (referer: https://www.auto1.com/v1/car-details-view/NE29415/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ96076/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV82977> (referer: https://www.auto1.com/v1/car-details-view/BV82977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB90564/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Scrape type for GZ17275: 1
2026-03-28 18:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS29828> (referer: https://www.auto1.com/v1/car-details-view/RS29828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Scrape type for GJ73585: 1
2026-03-28 18:40:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Scrape type for GY04691: 2
2026-03-28 18:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4aa66a7a-519a-511f-8617-b343f7e246f8 with identifier: GY04691
2026-03-28 18:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4aa66a7a-519a-511f-8617-b343f7e246f8 with scrape type 2
2026-03-28 18:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4aa66a7a-519a-511f-8617-b343f7e246f8 with scrape type 2
2026-03-28 18:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4aa66a7a-519a-511f-8617-b343f7e246f8, identifier: GY04691
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-28 18:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4aa66a7a-519a-511f-8617-b343f7e246f8 with identifier: GY04691
2026-03-28 18:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4aa66a7a-519a-511f-8617-b343f7e246f8 with identifier: GY04691
2026-03-28 18:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4aa66a7a-519a-511f-8617-b343f7e246f8 with identifier: GY04691 to the API
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:48Z',
 'fuel_type': 'diesel',
 'id': '4aa66a7a-519a-511f-8617-b343f7e246f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY04691',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 232017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-07',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Match BlueMotion',
 'transmission': 'automatic',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY04691%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Saving data for GY04691: {'auction_closing_time': 1774885908.0, 'created_time': 1774349634.120146, 'last_price_update_time': 1774723259.836905}
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY04691') HTTP/1.1" 204 0
2026-03-28 18:40:59 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-28 18:40:59 [auto1.de] INFO: Scrape type for WD20973: 2
2026-03-28 18:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7297c39-e463-5d69-b5bc-bb886a43bfbe with identifier: WD20973
2026-03-28 18:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7297c39-e463-5d69-b5bc-bb886a43bfbe with scrape type 2
2026-03-28 18:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7297c39-e463-5d69-b5bc-bb886a43bfbe with scrape type 2
2026-03-28 18:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7297c39-e463-5d69-b5bc-bb886a43bfbe, identifier: WD20973
2026-03-28 18:41:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_615b41bb1d165eae5b1e6fa45f4b5568.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7297c39-e463-5d69-b5bc-bb886a43bfbe with identifier: WD20973
2026-03-28 18:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7297c39-e463-5d69-b5bc-bb886a43bfbe with identifier: WD20973
2026-03-28 18:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7297c39-e463-5d69-b5bc-bb886a43bfbe with identifier: WD20973 to the API
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:26:16Z',
 'fuel_type': 'petrol',
 'id': 'c7297c39-e463-5d69-b5bc-bb886a43bfbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD20973',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 141810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD20973%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Saving data for WD20973: {'auction_closing_time': 1774884376.0, 'created_time': 1774089318.523952, 'last_price_update_time': 1774723260.475311}
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD20973') HTTP/1.1" 204 0
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: JD07645
2026-03-28 18:41:00 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [auto1.de] INFO: Scrape type for RN07993: 1
2026-03-28 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 405d8db0-717e-542e-a79f-040449742afa with identifier: ZD03679
2026-03-28 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 405d8db0-717e-542e-a79f-040449742afa with scrape type 1
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 405d8db0-717e-542e-a79f-040449742afa
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_d7ab2c2e7509de74ec47e0941fdb2ffe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_d7ab2c2e7509de74ec47e0941fdb2ffe.jpg not downloaded yet
2026-03-28 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7170bc35-b369-51fe-9853-ccc3996dc328 with identifier: NE29415
2026-03-28 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7170bc35-b369-51fe-9853-ccc3996dc328 with scrape type 1
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7170bc35-b369-51fe-9853-ccc3996dc328
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_edae98e28c98eebe464c8965c044213a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_edae98e28c98eebe464c8965c044213a.jpg not downloaded yet
2026-03-28 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52d22574-6129-5137-af37-016dabcc8093 with identifier: BV82977
2026-03-28 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52d22574-6129-5137-af37-016dabcc8093 with scrape type 1
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 52d22574-6129-5137-af37-016dabcc8093
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F67%252Fd667a580e13294571f795a89ba78ecde%252Fpa%252FBV82977_ad0e22640086185bf95e5f8e8f5174df.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_ad0e22640086185bf95e5f8e8f5174df.jpg already downloaded
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F67%252Fd667a580e13294571f795a89ba78ecde%252Fpa%252FBV82977_ce56d5283c50f8080085fd01a0e9903d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_ce56d5283c50f8080085fd01a0e9903d.jpg already downloaded
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F67%252Fd667a580e13294571f795a89ba78ecde%252Fpa%252FBV82977_532846c1489844a5cb069f5358656536.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_532846c1489844a5cb069f5358656536.jpg already downloaded
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F67%252Fd667a580e13294571f795a89ba78ecde%252Fpa%252FBV82977_aeecacdd314e9ac5c2195cf66ac9845f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_aeecacdd314e9ac5c2195cf66ac9845f.jpg already downloaded
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F67%252Fd667a580e13294571f795a89ba78ecde%252Fpa%252FBV82977_12ba0a45677c5ae950c7f2400752d2b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_12ba0a45677c5ae950c7f2400752d2b6.jpg already downloaded
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd6%252F67%252Fd667a580e13294571f795a89ba78ecde%252Fpa%252FBV82977_365ea557c459d50e8f8014a0d3f253dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_365ea557c459d50e8f8014a0d3f253dd.jpg already downloaded
2026-03-28 18:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52d22574-6129-5137-af37-016dabcc8093, identifier: BV82977
2026-03-28 18:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 452d4ce6-60d2-54c4-969e-220d7d63db57 with identifier: RS29828
2026-03-28 18:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 452d4ce6-60d2-54c4-969e-220d7d63db57 with scrape type 1
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_ebe7192fc50bda0dca823a3505d615a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ebe7192fc50bda0dca823a3505d615a0.jpg not downloaded yet
2026-03-28 18:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52d22574-6129-5137-af37-016dabcc8093 with identifier: BV82977
2026-03-28 18:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52d22574-6129-5137-af37-016dabcc8093 with identifier: BV82977
2026-03-28 18:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52d22574-6129-5137-af37-016dabcc8093 with identifier: BV82977 to the API
2026-03-28 18:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BV82977>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': 'Rental',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:58:32Z',
 'fuel_type': 'petrol',
 'id': '52d22574-6129-5137-af37-016dabcc8093',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV82977',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 141433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_ad0e22640086185bf95e5f8e8f5174df.jpg',
                'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_ce56d5283c50f8080085fd01a0e9903d.jpg',
                'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_532846c1489844a5cb069f5358656536.jpg',
                'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_aeecacdd314e9ac5c2195cf66ac9845f.jpg',
                'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_12ba0a45677c5ae950c7f2400752d2b6.jpg',
                'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_365ea557c459d50e8f8014a0d3f253dd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d22574-6129-5137-af37-016dabcc8093/52d22574-6129-5137-af37-016dabcc8093_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_ad0e22640086185bf95e5f8e8f5174df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d22574-6129-5137-af37-016dabcc8093/52d22574-6129-5137-af37-016dabcc8093_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88886,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_ce56d5283c50f8080085fd01a0e9903d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d22574-6129-5137-af37-016dabcc8093/52d22574-6129-5137-af37-016dabcc8093_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_532846c1489844a5cb069f5358656536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d22574-6129-5137-af37-016dabcc8093/52d22574-6129-5137-af37-016dabcc8093_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_aeecacdd314e9ac5c2195cf66ac9845f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d22574-6129-5137-af37-016dabcc8093/52d22574-6129-5137-af37-016dabcc8093_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_12ba0a45677c5ae950c7f2400752d2b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52d22574-6129-5137-af37-016dabcc8093/52d22574-6129-5137-af37-016dabcc8093_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd6/67/d667a580e13294571f795a89ba78ecde/pa/BV82977_365ea557c459d50e8f8014a0d3f253dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Concept',
 'transmission': 'manual',
 'trim': 'Concept',
 'year': 2011}
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV82977%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Saving data for BV82977: {'created_time': 1774723261.137475, 'last_price_update_time': 1774723261.13749, 'auction_closing_time': 1774886312.0}
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV82977') HTTP/1.1" 204 0
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for EC99072: 2
2026-03-28 18:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with identifier: EC99072
2026-03-28 18:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with scrape type 2
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with scrape type 2
2026-03-28 18:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5, identifier: EC99072
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_7d2007bf39512a3206bfe5e5d42d3138.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_7d2007bf39512a3206bfe5e5d42d3138.jpg not downloaded yet
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_bbac06957a9c3edad3bd16d7f05af562.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_bbac06957a9c3edad3bd16d7f05af562.jpg not downloaded yet
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_608bccf21d0426e491bd0e50cd24bbb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_608bccf21d0426e491bd0e50cd24bbb0.jpg not downloaded yet
2026-03-28 18:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with identifier: EC99072
2026-03-28 18:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with identifier: EC99072
2026-03-28 18:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e0ed29c-ae28-5c5a-ae48-134d3116a8c5 with identifier: EC99072 to the API
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:36Z',
 'fuel_type': 'petrol',
 'id': '8e0ed29c-ae28-5c5a-ae48-134d3116a8c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC99072',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 68380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-11',
 'seller_name': None,
 'title': 'Skoda Karoq 1.5 TSI ACT Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2022}
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC99072%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Saving data for EC99072: {'auction_closing_time': 1774883016.0, 'created_time': 1774034492.231169, 'last_price_update_time': 1774723261.689801}
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC99072') HTTP/1.1" 204 0
2026-03-28 18:41:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be88350>
2026-03-28 18:41:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252Fd9%252F19d95aecc99f1fb953c6a7a85f99e0e3%252Fpa%252FCA31284_615b41bb1d165eae5b1e6fa45f4b5568.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_615b41bb1d165eae5b1e6fa45f4b5568.jpg saved to cache
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7
2026-03-28 18:41:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7, skipping ID generation
2026-03-28 18:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with scrape type 1
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 sending to next pipeline
2026-03-28 18:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7, identifier: CA31284
2026-03-28 18:41:01 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [auto1.de] INFO: Scrape type for EN09392: 1
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_b2665d6176fbf022b91809a868436ee1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_b2665d6176fbf022b91809a868436ee1.jpg not downloaded yet
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_6abf8fc4013eea4885845cba649fbc86.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_6abf8fc4013eea4885845cba649fbc86.jpg not downloaded yet
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_18845682c84513a85c9e52a82b6e989f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_18845682c84513a85c9e52a82b6e989f.jpg not downloaded yet
2026-03-28 18:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with identifier: CA31284
2026-03-28 18:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with identifier: CA31284
2026-03-28 18:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b754b43-6b64-533a-aa24-6d7f6fcaf3d7 with identifier: CA31284 to the API
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_615b41bb1d165eae5b1e6fa45f4b5568.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:57:41Z',
 'fuel_type': 'diesel',
 'id': '5b754b43-6b64-533a-aa24-6d7f6fcaf3d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA31284',
 'listing': 'auction',
 'location': 'DE, Landsberg am Lech',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 130762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_bd942787576bfd310caab920eb2c5716.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_9f7e2b31119e5e66b53d643e4ad14823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_032abc697ae33f4350477c768b0d25ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_426229dc2474dec94aaff2891539b6cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2350576,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_2b28d08dd505cbd38ccf1b4422399b95.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2411307,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_615b41bb1d165eae5b1e6fa45f4b5568.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_9f1c0a23b879bea022776bd27bab2bf0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82417,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_8be7e3ce19ae03ce86b36faff520bc56.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70452,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_ba19b9fc3d89a1b81fc5d48d885bdfc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b754b43-6b64-533a-aa24-6d7f6fcaf3d7/5b754b43-6b64-533a-aa24-6d7f6fcaf3d7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/d9/19d95aecc99f1fb953c6a7a85f99e0e3/pa/CA31284_564ce31dbd288896fa57b209ecfc7d35.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2019}
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA31284%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Saving data for CA31284: {'created_time': 1774723262.415994, 'last_price_update_time': 1774723262.416007, 'auction_closing_time': 1774886261.0}
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA31284') HTTP/1.1" 204 0
2026-03-28 18:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XK86012> (referer: https://www.auto1.com/v1/car-details-view/XK86012/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Scrape type for DT06996: 1
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_54aedf2f9b71093621019cadc93dcb28.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_54aedf2f9b71093621019cadc93dcb28.jpg not downloaded yet
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_b382d000a44c9b8db7b9d6f48171c64b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_b382d000a44c9b8db7b9d6f48171c64b.jpg not downloaded yet
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_f92369d5e4b2954791b640130a640181.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_f92369d5e4b2954791b640130a640181.jpg not downloaded yet
2026-03-28 18:41:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WB83413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ82101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-28 18:41:02 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [auto1.de] INFO: Scrape type for DK35136: 2
2026-03-28 18:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0bc06f2-a1a6-5e04-823d-968e475c7f9a with identifier: DK35136
2026-03-28 18:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0bc06f2-a1a6-5e04-823d-968e475c7f9a with scrape type 2
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0bc06f2-a1a6-5e04-823d-968e475c7f9a with scrape type 2
2026-03-28 18:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0bc06f2-a1a6-5e04-823d-968e475c7f9a, identifier: DK35136
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_f618165d902f5ad6ea7ffda1d76d95ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_f618165d902f5ad6ea7ffda1d76d95ea.jpg not downloaded yet
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_f3e5641ea502b03d38deacd3d005a539.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_f3e5641ea502b03d38deacd3d005a539.jpg not downloaded yet
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_e696fb16797eccccfe3475169deba4ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_e696fb16797eccccfe3475169deba4ca.jpg not downloaded yet
2026-03-28 18:41:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0bc06f2-a1a6-5e04-823d-968e475c7f9a with identifier: DK35136
2026-03-28 18:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0bc06f2-a1a6-5e04-823d-968e475c7f9a with identifier: DK35136
2026-03-28 18:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0bc06f2-a1a6-5e04-823d-968e475c7f9a with identifier: DK35136 to the API
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:28:48Z',
 'fuel_type': 'diesel',
 'id': 'f0bc06f2-a1a6-5e04-823d-968e475c7f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK35136',
 'listing': 'auction',
 'make': 'Kia',
 'model': "pro_cee'd",
 'odometer': 144228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-06',
 'seller_name': None,
 'title': "Kia pro_cee'd 1.6 CRDi GT Line",
 'transmission': 'automatic',
 'trim': 'GT Line',
 'year': 2020}
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK35136%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Saving data for DK35136: {'auction_closing_time': 1774884528.0, 'created_time': 1774033797.310434, 'last_price_update_time': 1774723263.02565}
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK35136') HTTP/1.1" 204 0
2026-03-28 18:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_18845682c84513a85c9e52a82b6e989f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Scrape type for WJ60429: 1
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_7d5fb3cf03adf0d01cc3358cfb935ef4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_7d5fb3cf03adf0d01cc3358cfb935ef4.jpg not downloaded yet
2026-03-28 18:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC64408> (referer: https://www.auto1.com/v1/car-details-view/AC64408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PB68045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JR52179/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 501a9d1d-ea59-57b2-a48c-2acd83c690cb with identifier: XK86012
2026-03-28 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb with scrape type 1
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_818ed854efab5ec55d1a26bfada3ec27.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_818ed854efab5ec55d1a26bfada3ec27.jpg not downloaded yet
2026-03-28 18:41:03 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 6006 | hits on page: 40
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Scrape type for RX22328: 1
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_ce6233800e2b31c34cb03940a81db51d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ce6233800e2b31c34cb03940a81db51d.jpg not downloaded yet
2026-03-28 18:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_8cbbd0138633af6f9330d8f32c1690cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_8cbbd0138633af6f9330d8f32c1690cf.jpg not downloaded yet
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Scrape type for JR48888: 2
2026-03-28 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fed6deb-8583-5ab0-8553-27c469d4d974 with identifier: JR48888
2026-03-28 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fed6deb-8583-5ab0-8553-27c469d4d974 with scrape type 2
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fed6deb-8583-5ab0-8553-27c469d4d974 with scrape type 2
2026-03-28 18:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fed6deb-8583-5ab0-8553-27c469d4d974, identifier: JR48888
2026-03-28 18:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_b382d000a44c9b8db7b9d6f48171c64b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_54aedf2f9b71093621019cadc93dcb28.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-28 18:41:03 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Scrape type for FG48361: 2
2026-03-28 18:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9625a7c-7e12-5fe1-b859-012458379979 with identifier: FG48361
2026-03-28 18:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9625a7c-7e12-5fe1-b859-012458379979 with scrape type 2
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9625a7c-7e12-5fe1-b859-012458379979 with scrape type 2
2026-03-28 18:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9625a7c-7e12-5fe1-b859-012458379979, identifier: FG48361
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_c4675cf820ae7e6a5065ff821755e831.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_c4675cf820ae7e6a5065ff821755e831.jpg not downloaded yet
2026-03-28 18:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fed6deb-8583-5ab0-8553-27c469d4d974 with identifier: JR48888
2026-03-28 18:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fed6deb-8583-5ab0-8553-27c469d4d974 with identifier: JR48888
2026-03-28 18:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fed6deb-8583-5ab0-8553-27c469d4d974 with identifier: JR48888 to the API
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:46:33Z',
 'fuel_type': 'petrol',
 'id': '1fed6deb-8583-5ab0-8553-27c469d4d974',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR48888',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 98341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-29',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR48888%27 HTTP/1.1" 200 None
2026-03-28 18:41:03 [auto1.de] INFO: Saving data for JR48888: {'auction_closing_time': 1774885593.0, 'created_time': 1773428009.491623, 'last_price_update_time': 1774723263.770874}
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR48888') HTTP/1.1" 204 0
2026-03-28 18:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9625a7c-7e12-5fe1-b859-012458379979 with identifier: FG48361
2026-03-28 18:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9625a7c-7e12-5fe1-b859-012458379979 with identifier: FG48361
2026-03-28 18:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9625a7c-7e12-5fe1-b859-012458379979 with identifier: FG48361 to the API
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:11Z',
 'fuel_type': 'petrol',
 'id': 'b9625a7c-7e12-5fe1-b859-012458379979',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG48361',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 75331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-15',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI FR-Line',
 'transmission': 'automatic',
 'trim': 'FR-Line',
 'year': 2020}
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG48361%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Saving data for FG48361: {'auction_closing_time': 1774884311.0, 'created_time': 1774349814.166741, 'last_price_update_time': 1774723264.285443}
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG48361') HTTP/1.1" 204 0
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_51f7b79e88fb316befba4ee2864a2949.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_51f7b79e88fb316befba4ee2864a2949.jpg not downloaded yet
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for WX17645: 1
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beafe10>
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_18845682c84513a85c9e52a82b6e989f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_18845682c84513a85c9e52a82b6e989f.jpg saved to cache
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_f92369d5e4b2954791b640130a640181.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for VE13678: 1
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_9e9980a9a21b7c6b9851089859f93686.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_9e9980a9a21b7c6b9851089859f93686.jpg not downloaded yet
2026-03-28 18:41:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_f3e5641ea502b03d38deacd3d005a539.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_a433cdad2dc2d06b16440ed76018d850.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_a433cdad2dc2d06b16440ed76018d850.jpg not downloaded yet
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for FP27721: 2
2026-03-28 18:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bdd271b-1515-5276-a79e-9cd510776cd5 with identifier: FP27721
2026-03-28 18:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bdd271b-1515-5276-a79e-9cd510776cd5 with scrape type 2
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bdd271b-1515-5276-a79e-9cd510776cd5 with scrape type 2
2026-03-28 18:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bdd271b-1515-5276-a79e-9cd510776cd5, identifier: FP27721
2026-03-28 18:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with identifier: AC64408
2026-03-28 18:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with scrape type 1
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_db5aaa5ef74bddd283f1595676c8c3e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_db5aaa5ef74bddd283f1595676c8c3e1.jpg not downloaded yet
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17ea10>
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_b382d000a44c9b8db7b9d6f48171c64b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_b382d000a44c9b8db7b9d6f48171c64b.jpg saved to cache
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7170bc35-b369-51fe-9853-ccc3996dc328
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe4c50>
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_54aedf2f9b71093621019cadc93dcb28.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_54aedf2f9b71093621019cadc93dcb28.jpg saved to cache
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 405d8db0-717e-542e-a79f-040449742afa
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-28 18:41:04 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [auto1.de] INFO: Scrape type for WM91088: 2
2026-03-28 18:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30adee3e-41aa-5875-9124-ac6d07a4cf1c with identifier: WM91088
2026-03-28 18:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30adee3e-41aa-5875-9124-ac6d07a4cf1c with scrape type 2
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30adee3e-41aa-5875-9124-ac6d07a4cf1c with scrape type 2
2026-03-28 18:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30adee3e-41aa-5875-9124-ac6d07a4cf1c, identifier: WM91088
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_006a3fef21709d836e6dad33fa339115.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_006a3fef21709d836e6dad33fa339115.jpg not downloaded yet
2026-03-28 18:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bdd271b-1515-5276-a79e-9cd510776cd5 with identifier: FP27721
2026-03-28 18:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bdd271b-1515-5276-a79e-9cd510776cd5 with identifier: FP27721
2026-03-28 18:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bdd271b-1515-5276-a79e-9cd510776cd5 with identifier: FP27721 to the API
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:57:58Z',
 'fuel_type': 'petrol',
 'id': '8bdd271b-1515-5276-a79e-9cd510776cd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP27721',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 135213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-07',
 'seller_name': None,
 'title': 'Jeep Compass 2.0 Sport 4x2',
 'transmission': 'manual',
 'trim': 'Sport 4x2',
 'year': 2013}
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27721%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [auto1.de] INFO: Saving data for FP27721: {'auction_closing_time': 1774886278.0, 'created_time': 1774349711.497326, 'last_price_update_time': 1774723265.230568}
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP27721') HTTP/1.1" 204 0
2026-03-28 18:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ce6233800e2b31c34cb03940a81db51d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30adee3e-41aa-5875-9124-ac6d07a4cf1c with identifier: WM91088
2026-03-28 18:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30adee3e-41aa-5875-9124-ac6d07a4cf1c with identifier: WM91088
2026-03-28 18:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30adee3e-41aa-5875-9124-ac6d07a4cf1c with identifier: WM91088 to the API
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:43Z',
 'fuel_type': 'diesel',
 'id': '30adee3e-41aa-5875-9124-ac6d07a4cf1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM91088',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Kombi',
 'odometer': 354472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': None,
 'title': 'Volkswagen T6 Kombi 2.0 TDI 4Motion',
 'transmission': 'manual',
 'trim': '4Motion',
 'year': 2018}
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91088%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [auto1.de] INFO: Saving data for WM91088: {'auction_closing_time': 1774884163.0, 'created_time': 1773467064.317962, 'last_price_update_time': 1774723265.606018}
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM91088') HTTP/1.1" 204 0
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_fefdc08e44829822d4986c8a488d947d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_fefdc08e44829822d4986c8a488d947d.jpg not downloaded yet
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [auto1.de] INFO: Scrape type for KC60426: 1
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_ba14cc2a9fce4e2130f741db2fbdadea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_ba14cc2a9fce4e2130f741db2fbdadea.jpg not downloaded yet
2026-03-28 18:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_8cbbd0138633af6f9330d8f32c1690cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [auto1.de] INFO: Scrape type for CG06120: 1
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc5e5d0>
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_f92369d5e4b2954791b640130a640181.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_f92369d5e4b2954791b640130a640181.jpg saved to cache
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc95810>
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_f3e5641ea502b03d38deacd3d005a539.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_f3e5641ea502b03d38deacd3d005a539.jpg saved to cache
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7170bc35-b369-51fe-9853-ccc3996dc328
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_6af11414da5644d528dbfaf6fde0d92f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_6af11414da5644d528dbfaf6fde0d92f.jpg not downloaded yet
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [auto1.de] INFO: Scrape type for EL78604: 1
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_d477b2ffa35564fe5561b4c6ad4cc104.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_d477b2ffa35564fe5561b4c6ad4cc104.jpg not downloaded yet
2026-03-28 18:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ67055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF23268/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [auto1.de] INFO: Scrape type for XX47236: 1
2026-03-28 18:41:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL01555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA78506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10d590>
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_ce6233800e2b31c34cb03940a81db51d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ce6233800e2b31c34cb03940a81db51d.jpg saved to cache
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-28 18:41:05 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-28 18:41:05 [auto1.de] INFO: Scrape type for KP52427: 2
2026-03-28 18:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with identifier: KP52427
2026-03-28 18:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with scrape type 2
2026-03-28 18:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with scrape type 2
2026-03-28 18:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a, identifier: KP52427
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_309d7cd0bb0b66ca79083806048098ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_309d7cd0bb0b66ca79083806048098ee.jpg not downloaded yet
2026-03-28 18:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for AY24824: 1
2026-03-28 18:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with identifier: KP52427
2026-03-28 18:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with identifier: KP52427
2026-03-28 18:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a with identifier: KP52427 to the API
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:27Z',
 'fuel_type': 'petrol',
 'id': 'b9d9b848-96ea-5fe6-9b4d-c799e7b52e5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP52427',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 141501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-04',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP52427%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Saving data for KP52427: {'auction_closing_time': 1774882947.0, 'created_time': 1774032859.680985, 'last_price_update_time': 1774723266.352996}
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP52427') HTTP/1.1" 204 0
2026-03-28 18:41:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd0f10>
2026-03-28 18:41:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_8cbbd0138633af6f9330d8f32c1690cf.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_8cbbd0138633af6f9330d8f32c1690cf.jpg saved to cache
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for UZ60031: 1
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_88ff90726601cf5edc2fdea4c7a65b0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_88ff90726601cf5edc2fdea4c7a65b0b.jpg not downloaded yet
2026-03-28 18:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_ba14cc2a9fce4e2130f741db2fbdadea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for YP26052: 1
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_c492ceedce07db3a0a73b5291f1ce98d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_c492ceedce07db3a0a73b5291f1ce98d.jpg not downloaded yet
2026-03-28 18:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US66744> (referer: https://www.auto1.com/v1/car-details-view/US66744/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM31898/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_d477b2ffa35564fe5561b4c6ad4cc104.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-28 18:41:06 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [auto1.de] INFO: Scrape type for UX04638: 2
2026-03-28 18:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38050cb7-bcfb-599e-a22e-2bc8deb93957 with identifier: UX04638
2026-03-28 18:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38050cb7-bcfb-599e-a22e-2bc8deb93957 with scrape type 2
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38050cb7-bcfb-599e-a22e-2bc8deb93957 with scrape type 2
2026-03-28 18:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38050cb7-bcfb-599e-a22e-2bc8deb93957, identifier: UX04638
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_881b6df66f8cea1c030ab15da3da8a9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_881b6df66f8cea1c030ab15da3da8a9e.jpg not downloaded yet
2026-03-28 18:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38050cb7-bcfb-599e-a22e-2bc8deb93957 with identifier: UX04638
2026-03-28 18:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38050cb7-bcfb-599e-a22e-2bc8deb93957 with identifier: UX04638
2026-03-28 18:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38050cb7-bcfb-599e-a22e-2bc8deb93957 with identifier: UX04638 to the API
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:29:35Z',
 'fuel_type': 'petrol',
 'id': '38050cb7-bcfb-599e-a22e-2bc8deb93957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX04638',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 99945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-28',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX04638%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Saving data for UX04638: {'auction_closing_time': 1774884575.0, 'created_time': 1773905433.337493, 'last_price_update_time': 1774723267.056166}
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX04638') HTTP/1.1" 204 0
2026-03-28 18:41:07 [scrapy.extensions.logstats] INFO: Crawled 423 pages (at 85 pages/min), scraped 658 items (at 75 items/min)
2026-03-28 18:41:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Scrape type for XT42092: 1
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_2842a0a51f60ab5cb5a88d032abf0561.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_2842a0a51f60ab5cb5a88d032abf0561.jpg not downloaded yet
2026-03-28 18:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB16135> (referer: https://www.auto1.com/v1/car-details-view/JB16135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2192d0>
2026-03-28 18:41:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_ba14cc2a9fce4e2130f741db2fbdadea.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_ba14cc2a9fce4e2130f741db2fbdadea.jpg saved to cache
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54315052-af72-57db-b053-c7b4de7fa63d with identifier: US66744
2026-03-28 18:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54315052-af72-57db-b053-c7b4de7fa63d with scrape type 1
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_21bc0b18fed4ffb048fa911a2a0a4312.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_21bc0b18fed4ffb048fa911a2a0a4312.jpg not downloaded yet
2026-03-28 18:41:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbbbd10>
2026-03-28 18:41:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_d477b2ffa35564fe5561b4c6ad4cc104.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_d477b2ffa35564fe5561b4c6ad4cc104.jpg saved to cache
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Scrape type for ER27214: 1
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_174722c2cc3094b9f2199b896493ad5d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_174722c2cc3094b9f2199b896493ad5d.jpg not downloaded yet
2026-03-28 18:41:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_c492ceedce07db3a0a73b5291f1ce98d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_7450e013c48678b980597375bd2efc30.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_7450e013c48678b980597375bd2efc30.jpg not downloaded yet
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Scrape type for DU68074: 2
2026-03-28 18:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71e4824a-504e-5865-b11d-1e64a1740a05 with identifier: DU68074
2026-03-28 18:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71e4824a-504e-5865-b11d-1e64a1740a05 with scrape type 2
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71e4824a-504e-5865-b11d-1e64a1740a05 with scrape type 2
2026-03-28 18:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71e4824a-504e-5865-b11d-1e64a1740a05, identifier: DU68074
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_ebe6a3ee14ee2c93dfc40142eaa8a325.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_ebe6a3ee14ee2c93dfc40142eaa8a325.jpg not downloaded yet
2026-03-28 18:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71e4824a-504e-5865-b11d-1e64a1740a05 with identifier: DU68074
2026-03-28 18:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71e4824a-504e-5865-b11d-1e64a1740a05 with identifier: DU68074
2026-03-28 18:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71e4824a-504e-5865-b11d-1e64a1740a05 with identifier: DU68074 to the API
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:33:44Z',
 'fuel_type': 'petrol',
 'id': '71e4824a-504e-5865-b11d-1e64a1740a05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU68074',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 120837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2011}
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU68074%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Saving data for DU68074: {'auction_closing_time': 1774884824.0, 'created_time': 1774032304.200163, 'last_price_update_time': 1774723267.858486}
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DU68074') HTTP/1.1" 204 0
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_a80c37e95732003882590ddb21265c6c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_a80c37e95732003882590ddb21265c6c.jpg not downloaded yet
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-28 18:41:07 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-28 18:41:07 [auto1.de] INFO: Scrape type for ZN38550: 2
2026-03-28 18:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with identifier: ZN38550
2026-03-28 18:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with scrape type 2
2026-03-28 18:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with scrape type 2
2026-03-28 18:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f, identifier: ZN38550
2026-03-28 18:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b22321c4-a09d-5a78-9987-c4a825a27d1e with identifier: JB16135
2026-03-28 18:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b22321c4-a09d-5a78-9987-c4a825a27d1e with scrape type 1
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_ad955995d89f91796dcb946e0a650a69.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ad955995d89f91796dcb946e0a650a69.jpg not downloaded yet
2026-03-28 18:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with identifier: ZN38550
2026-03-28 18:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with identifier: ZN38550
2026-03-28 18:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2b20905-7d4e-5ef3-9e1b-ac8929a6235f with identifier: ZN38550 to the API
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:48:16Z',
 'fuel_type': 'diesel',
 'id': 'b2b20905-7d4e-5ef3-9e1b-ac8929a6235f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN38550',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 223217,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-07',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI lang BlueEfficiency Ambiente Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueEfficiency Ambiente Edition',
 'year': 2013}
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN38550%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Saving data for ZN38550: {'auction_closing_time': 1774885696.0, 'created_time': 1774350208.274618, 'last_price_update_time': 1774723268.360309}
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN38550') HTTP/1.1" 204 0
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_42d656f254fcfd100994d1a6162e3e3c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_42d656f254fcfd100994d1a6162e3e3c.jpg not downloaded yet
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for TR40985: 1
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_da853f9e81db93c7bf5523fa15d74d10.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_da853f9e81db93c7bf5523fa15d74d10.jpg not downloaded yet
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_cba80cf8ed8dd14fbf5f3676e7885633.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_cba80cf8ed8dd14fbf5f3676e7885633.jpg not downloaded yet
2026-03-28 18:41:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b191850>
2026-03-28 18:41:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_c492ceedce07db3a0a73b5291f1ce98d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_c492ceedce07db3a0a73b5291f1ce98d.jpg saved to cache
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for BW25069: 1
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_3388d6c12af84398b7bbca62707e00da.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_3388d6c12af84398b7bbca62707e00da.jpg not downloaded yet
2026-03-28 18:41:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CG06120/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_8430822e134c6e54920612c27a095ec1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_8430822e134c6e54920612c27a095ec1.jpg not downloaded yet
2026-03-28 18:41:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:08 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [auto1.de] INFO: Scrape type for UH14714: 2
2026-03-28 18:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12e1bb21-1269-5538-98f2-2df346cb91fd with identifier: UH14714
2026-03-28 18:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12e1bb21-1269-5538-98f2-2df346cb91fd with scrape type 2
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12e1bb21-1269-5538-98f2-2df346cb91fd with scrape type 2
2026-03-28 18:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12e1bb21-1269-5538-98f2-2df346cb91fd, identifier: UH14714
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_5eea66877728dc23f45bfaf30505d576.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_5eea66877728dc23f45bfaf30505d576.jpg not downloaded yet
2026-03-28 18:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12e1bb21-1269-5538-98f2-2df346cb91fd with identifier: UH14714
2026-03-28 18:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12e1bb21-1269-5538-98f2-2df346cb91fd with identifier: UH14714
2026-03-28 18:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12e1bb21-1269-5538-98f2-2df346cb91fd with identifier: UH14714 to the API
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:33Z',
 'fuel_type': 'petrol',
 'id': '12e1bb21-1269-5538-98f2-2df346cb91fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH14714',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 236378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-15',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Saving data for UH14714: {'auction_closing_time': 1774885353.0, 'created_time': 1774118372.059754, 'last_price_update_time': 1774723269.016515}
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH14714') HTTP/1.1" 204 0
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_f4c96281d2b8e59934c7d3c8d060c505.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_f4c96281d2b8e59934c7d3c8d060c505.jpg not downloaded yet
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EL78604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:09 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Scrape type for WR70011: 1
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_ff2309c709a97d30fed5fbacf1ae20f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ff2309c709a97d30fed5fbacf1ae20f6.jpg not downloaded yet
2026-03-28 18:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_cba80cf8ed8dd14fbf5f3676e7885633.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_9c0f4f51ff87375843a3747b206f6b41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_9c0f4f51ff87375843a3747b206f6b41.jpg not downloaded yet
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_74de83e4ee07005b2de1cc7ffa6f19be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_74de83e4ee07005b2de1cc7ffa6f19be.jpg not downloaded yet
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GJ73585/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WX17645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JR52179> (referer: https://www.auto1.com/v1/car-details-view/JR52179/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_c27ba9aa56480fa8a8e4b0f303b9f313.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_c27ba9aa56480fa8a8e4b0f303b9f313.jpg not downloaded yet
2026-03-28 18:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_23bdcd42896db981d5812d5784f7439f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_23bdcd42896db981d5812d5784f7439f.jpg not downloaded yet
2026-03-28 18:41:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_0bae9d89185cb218408bc5698e41e168.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_0bae9d89185cb218408bc5698e41e168.jpg not downloaded yet
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_89b9c51dec0238cf0724ad206e3d18f5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_89b9c51dec0238cf0724ad206e3d18f5.jpg not downloaded yet
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_734079f697c9d865f399469426240244.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_734079f697c9d865f399469426240244.jpg not downloaded yet
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_c54d15620de64b841b92383020f6e6ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_c54d15620de64b841b92383020f6e6ce.jpg not downloaded yet
2026-03-28 18:41:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beda650>
2026-03-28 18:41:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_cba80cf8ed8dd14fbf5f3676e7885633.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_cba80cf8ed8dd14fbf5f3676e7885633.jpg saved to cache
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WJ60429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_5eea66877728dc23f45bfaf30505d576.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7b6a524-41ae-5436-8f96-b5e64cf2e877 with identifier: JR52179
2026-03-28 18:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7b6a524-41ae-5436-8f96-b5e64cf2e877 with scrape type 1
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7b6a524-41ae-5436-8f96-b5e64cf2e877
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_6541cb0a82a97ca3df6cc7c29f6c5b4c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_6541cb0a82a97ca3df6cc7c29f6c5b4c.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_fea112af49f7c4b93659aef7470aacc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_fea112af49f7c4b93659aef7470aacc1.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_40cc4494fa75482cae2071b6951d0eb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_40cc4494fa75482cae2071b6951d0eb7.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_9f42cdccd30bab7668ad25b2e3963782.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_9f42cdccd30bab7668ad25b2e3963782.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_f7e2cc52de24a819f99ff903266bcfb5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_f7e2cc52de24a819f99ff903266bcfb5.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_cb00c36d5589ec7d48ad567afcbfbcb1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_cb00c36d5589ec7d48ad567afcbfbcb1.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_bb964b6b423b23b77ec311b2f88c3e75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_bb964b6b423b23b77ec311b2f88c3e75.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_5461222bd7bee069ab335799dd4fc7d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_5461222bd7bee069ab335799dd4fc7d5.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_bce2c90c4296d758bc649cec396c6a50.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_bce2c90c4296d758bc649cec396c6a50.jpg already downloaded
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge7%252F7e%252Fe77eddc6ffe2ee739948dc2c8ccbffbc%252Fpa%252FJR52179_aeef902e8e218c6e01a26f7dd1bbaf19.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_aeef902e8e218c6e01a26f7dd1bbaf19.jpg already downloaded
2026-03-28 18:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7b6a524-41ae-5436-8f96-b5e64cf2e877, identifier: JR52179
2026-03-28 18:41:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_7d5fb3cf03adf0d01cc3358cfb935ef4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7b6a524-41ae-5436-8f96-b5e64cf2e877 with identifier: JR52179
2026-03-28 18:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7b6a524-41ae-5436-8f96-b5e64cf2e877 with identifier: JR52179
2026-03-28 18:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7b6a524-41ae-5436-8f96-b5e64cf2e877 with identifier: JR52179 to the API
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JR52179>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:21:03Z',
 'fuel_type': 'diesel',
 'id': 'c7b6a524-41ae-5436-8f96-b5e64cf2e877',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR52179',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 188222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_6541cb0a82a97ca3df6cc7c29f6c5b4c.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_fea112af49f7c4b93659aef7470aacc1.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_40cc4494fa75482cae2071b6951d0eb7.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_9f42cdccd30bab7668ad25b2e3963782.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_f7e2cc52de24a819f99ff903266bcfb5.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_cb00c36d5589ec7d48ad567afcbfbcb1.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_bb964b6b423b23b77ec311b2f88c3e75.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_5461222bd7bee069ab335799dd4fc7d5.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_bce2c90c4296d758bc649cec396c6a50.jpg',
                'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_aeef902e8e218c6e01a26f7dd1bbaf19.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_6541cb0a82a97ca3df6cc7c29f6c5b4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_fea112af49f7c4b93659aef7470aacc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55434,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_40cc4494fa75482cae2071b6951d0eb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_9f42cdccd30bab7668ad25b2e3963782.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_f7e2cc52de24a819f99ff903266bcfb5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_cb00c36d5589ec7d48ad567afcbfbcb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_bb964b6b423b23b77ec311b2f88c3e75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_5461222bd7bee069ab335799dd4fc7d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_bce2c90c4296d758bc649cec396c6a50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7b6a524-41ae-5436-8f96-b5e64cf2e877/c7b6a524-41ae-5436-8f96-b5e64cf2e877_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge7/7e/e77eddc6ffe2ee739948dc2c8ccbffbc/pa/JR52179_aeef902e8e218c6e01a26f7dd1bbaf19.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Cup BlueMotion',
 'transmission': 'automatic',
 'trim': 'Cup BlueMotion',
 'year': 2015}
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52179%27 HTTP/1.1" 200 None
2026-03-28 18:41:09 [auto1.de] INFO: Saving data for JR52179: {'created_time': 1774723269.994414, 'last_price_update_time': 1774723269.994426, 'auction_closing_time': 1774884063.0}
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR52179') HTTP/1.1" 204 0
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_f4c96281d2b8e59934c7d3c8d060c505.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_74de83e4ee07005b2de1cc7ffa6f19be.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_e696fb16797eccccfe3475169deba4ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_9c0f4f51ff87375843a3747b206f6b41.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY24824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5adcc8d0>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_5eea66877728dc23f45bfaf30505d576.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_5eea66877728dc23f45bfaf30505d576.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbee910>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_7d5fb3cf03adf0d01cc3358cfb935ef4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_7d5fb3cf03adf0d01cc3358cfb935ef4.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_c4675cf820ae7e6a5065ff821755e831.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_734079f697c9d865f399469426240244.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP26052/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b297810>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_f4c96281d2b8e59934c7d3c8d060c505.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_f4c96281d2b8e59934c7d3c8d060c505.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2708d0>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_74de83e4ee07005b2de1cc7ffa6f19be.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_74de83e4ee07005b2de1cc7ffa6f19be.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcd5c50>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_e696fb16797eccccfe3475169deba4ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_e696fb16797eccccfe3475169deba4ca.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b263590>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_9c0f4f51ff87375843a3747b206f6b41.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_9c0f4f51ff87375843a3747b206f6b41.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bedacd0>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_c4675cf820ae7e6a5065ff821755e831.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_c4675cf820ae7e6a5065ff821755e831.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ce9890>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_734079f697c9d865f399469426240244.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_734079f697c9d865f399469426240244.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_21bc0b18fed4ffb048fa911a2a0a4312.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_006a3fef21709d836e6dad33fa339115.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_c54d15620de64b841b92383020f6e6ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_89b9c51dec0238cf0724ad206e3d18f5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2048d0>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_21bc0b18fed4ffb048fa911a2a0a4312.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_21bc0b18fed4ffb048fa911a2a0a4312.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_23bdcd42896db981d5812d5784f7439f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA78506> (referer: https://www.auto1.com/v1/car-details-view/ZA78506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM31898> (referer: https://www.auto1.com/v1/car-details-view/LM31898/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bedad10>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_006a3fef21709d836e6dad33fa339115.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_006a3fef21709d836e6dad33fa339115.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b219ed0>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_c54d15620de64b841b92383020f6e6ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_c54d15620de64b841b92383020f6e6ce.jpg saved to cache
2026-03-28 18:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beac250>
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_89b9c51dec0238cf0724ad206e3d18f5.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_89b9c51dec0238cf0724ad206e3d18f5.jpg saved to cache
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CG06120> (referer: https://www.auto1.com/v1/car-details-view/CG06120/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b218ad0>
2026-03-28 18:41:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_23bdcd42896db981d5812d5784f7439f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_23bdcd42896db981d5812d5784f7439f.jpg saved to cache
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65e0557a-8cdf-5bff-9598-937c1ff5035a with identifier: ZA78506
2026-03-28 18:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e0557a-8cdf-5bff-9598-937c1ff5035a with scrape type 1
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 65e0557a-8cdf-5bff-9598-937c1ff5035a
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_53bed0a5af9ac21da0893fc632ba0b16.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_53bed0a5af9ac21da0893fc632ba0b16.jpg not downloaded yet
2026-03-28 18:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 425fc81b-d65b-5987-8573-82251aa0380b with identifier: LM31898
2026-03-28 18:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 425fc81b-d65b-5987-8573-82251aa0380b with scrape type 1
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 425fc81b-d65b-5987-8573-82251aa0380b
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_9bbdcd3b6a7b0d87cc2c58d50c284ca9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_9bbdcd3b6a7b0d87cc2c58d50c284ca9.jpg not downloaded yet
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_b3ed01712444b37866a7d3c60f32d99f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_b3ed01712444b37866a7d3c60f32d99f.jpg not downloaded yet
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_def8a0f9e578ea998099d3a45b9f54bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_def8a0f9e578ea998099d3a45b9f54bf.jpg not downloaded yet
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_11d7201eae26cdd3a3e43e375ca59431.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_11d7201eae26cdd3a3e43e375ca59431.jpg not downloaded yet
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_600bf0b93a1b1b7cd7e2d10f713676fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_600bf0b93a1b1b7cd7e2d10f713676fb.jpg not downloaded yet
2026-03-28 18:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with identifier: CG06120
2026-03-28 18:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with scrape type 1
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 27a16512-56e5-5c1c-8e95-8f1f22e3b235
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_20bda9352e7e82c9acaf14b7c075afc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_20bda9352e7e82c9acaf14b7c075afc1.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_dc07e0562c5c7978ba43021175e70f11.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_dc07e0562c5c7978ba43021175e70f11.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_e85f54563ada97be4cd5ba8e3b48c5dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_e85f54563ada97be4cd5ba8e3b48c5dd.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_2ba14b93fbdcd5599694fe7ce397bd41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_2ba14b93fbdcd5599694fe7ce397bd41.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_90b8fff9941609d84aa9d8b5dd9a3893.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_90b8fff9941609d84aa9d8b5dd9a3893.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_bb5e586e1dc24ce1db24bdc1324f139c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_bb5e586e1dc24ce1db24bdc1324f139c.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_afe49dc2b5df33fb6e85c89edcf1f54c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_afe49dc2b5df33fb6e85c89edcf1f54c.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_70043d0d1125f50c69596b6cf170354f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_70043d0d1125f50c69596b6cf170354f.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_a996e44f3a2920a68b14a753893444ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_a996e44f3a2920a68b14a753893444ba.jpg already downloaded
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F0f%252F6b0f11eef4a93b86604f730db547ee14%252Fpa%252FCG06120_dfab49674cc670ac78d899d840af1f8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_dfab49674cc670ac78d899d840af1f8e.jpg already downloaded
2026-03-28 18:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27a16512-56e5-5c1c-8e95-8f1f22e3b235, identifier: CG06120
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_95b3bb88509158df5eca923c63ac5cdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_95b3bb88509158df5eca923c63ac5cdd.jpg not downloaded yet
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_128918009c1349ab3c4300b42f438828.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_128918009c1349ab3c4300b42f438828.jpg not downloaded yet
2026-03-28 18:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with identifier: CG06120
2026-03-28 18:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with identifier: CG06120
2026-03-28 18:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27a16512-56e5-5c1c-8e95-8f1f22e3b235 with identifier: CG06120 to the API
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CG06120>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:16:21Z',
 'fuel_type': 'petrol',
 'id': '27a16512-56e5-5c1c-8e95-8f1f22e3b235',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG06120',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 123564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_20bda9352e7e82c9acaf14b7c075afc1.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_dc07e0562c5c7978ba43021175e70f11.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_e85f54563ada97be4cd5ba8e3b48c5dd.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_2ba14b93fbdcd5599694fe7ce397bd41.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_90b8fff9941609d84aa9d8b5dd9a3893.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_bb5e586e1dc24ce1db24bdc1324f139c.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_afe49dc2b5df33fb6e85c89edcf1f54c.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_70043d0d1125f50c69596b6cf170354f.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_a996e44f3a2920a68b14a753893444ba.jpg',
                'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_dfab49674cc670ac78d899d840af1f8e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_20bda9352e7e82c9acaf14b7c075afc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_dc07e0562c5c7978ba43021175e70f11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_e85f54563ada97be4cd5ba8e3b48c5dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68354,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_2ba14b93fbdcd5599694fe7ce397bd41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_90b8fff9941609d84aa9d8b5dd9a3893.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_bb5e586e1dc24ce1db24bdc1324f139c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_afe49dc2b5df33fb6e85c89edcf1f54c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_70043d0d1125f50c69596b6cf170354f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_a996e44f3a2920a68b14a753893444ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_27a16512-56e5-5c1c-8e95-8f1f22e3b235/27a16512-56e5-5c1c-8e95-8f1f22e3b235_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/0f/6b0f11eef4a93b86604f730db547ee14/pa/CG06120_dfab49674cc670ac78d899d840af1f8e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Venga 1.4 Dream Team',
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2015}
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG06120%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [auto1.de] INFO: Saving data for CG06120: {'created_time': 1774723271.922884, 'last_price_update_time': 1774723271.922897, 'auction_closing_time': 1774883781.0}
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG06120') HTTP/1.1" 204 0
2026-03-28 18:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ff2309c709a97d30fed5fbacf1ae20f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WX17645> (referer: https://www.auto1.com/v1/car-details-view/WX17645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_4c4a0791f0cf0c279a675be9957e3bcb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_4c4a0791f0cf0c279a675be9957e3bcb.jpg not downloaded yet
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_5502cf07e45e3ed90287742d1d5f9508.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_5502cf07e45e3ed90287742d1d5f9508.jpg not downloaded yet
2026-03-28 18:41:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GJ73585> (referer: https://www.auto1.com/v1/car-details-view/GJ73585/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EL78604> (referer: https://www.auto1.com/v1/car-details-view/EL78604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY24824> (referer: https://www.auto1.com/v1/car-details-view/AY24824/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_4fa1c44e19ba63b405dcc74b4ba7787a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_4fa1c44e19ba63b405dcc74b4ba7787a.jpg not downloaded yet
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_0bae9d89185cb218408bc5698e41e168.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_c27ba9aa56480fa8a8e4b0f303b9f313.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_8430822e134c6e54920612c27a095ec1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ce8450>
2026-03-28 18:41:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_ff2309c709a97d30fed5fbacf1ae20f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ff2309c709a97d30fed5fbacf1ae20f6.jpg saved to cache
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_11d7201eae26cdd3a3e43e375ca59431.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_5502cf07e45e3ed90287742d1d5f9508.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_4fa1c44e19ba63b405dcc74b4ba7787a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9acdd69d-6d7e-5b5b-a082-be29a8806632 with identifier: WX17645
2026-03-28 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acdd69d-6d7e-5b5b-a082-be29a8806632 with scrape type 1
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_9425e3e0810424d9a5939cd89457c2d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_9425e3e0810424d9a5939cd89457c2d1.jpg not downloaded yet
2026-03-28 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with identifier: GJ73585
2026-03-28 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with scrape type 1
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_71d59870a25162400cabae78f4939755.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_71d59870a25162400cabae78f4939755.jpg not downloaded yet
2026-03-28 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with identifier: EL78604
2026-03-28 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with scrape type 1
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_15a5b9d463673ddc72e9a040750644b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_15a5b9d463673ddc72e9a040750644b1.jpg not downloaded yet
2026-03-28 18:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df7eea43-18f8-5087-98a1-ace523b77072 with identifier: AY24824
2026-03-28 18:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df7eea43-18f8-5087-98a1-ace523b77072 with scrape type 1
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df7eea43-18f8-5087-98a1-ace523b77072
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_b9e6798c00cb1f9141b511b87fde57c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_b9e6798c00cb1f9141b511b87fde57c4.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_22a23768f6677919d559e8a6772d423e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_22a23768f6677919d559e8a6772d423e.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_051d940f98f72123cda755962f8acc17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_051d940f98f72123cda755962f8acc17.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_6a2415576e247f1007b79622fbda1c53.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_6a2415576e247f1007b79622fbda1c53.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_ef67fda0983ccfb405bf9e98fba4bc18.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_ef67fda0983ccfb405bf9e98fba4bc18.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_7e12e5cb6103f85879a0af1168072eef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_7e12e5cb6103f85879a0af1168072eef.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_d7129676cb6cbc6fa8037fb2b870c24f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_d7129676cb6cbc6fa8037fb2b870c24f.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_9b851c7e95962a403a69e967f5c37e41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_9b851c7e95962a403a69e967f5c37e41.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_83cf7103d4b7b2a158a9bcc1dc8829b6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_83cf7103d4b7b2a158a9bcc1dc8829b6.jpg already downloaded
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg23%252Fb6%252F23b67edc2908d1818a2a1f90bae943e3%252Fpa%252FAY24824_cb6c99821866aa2cbdb4f18e2d0127cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_cb6c99821866aa2cbdb4f18e2d0127cb.jpg already downloaded
2026-03-28 18:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df7eea43-18f8-5087-98a1-ace523b77072, identifier: AY24824
2026-03-28 18:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df7eea43-18f8-5087-98a1-ace523b77072 with identifier: AY24824
2026-03-28 18:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df7eea43-18f8-5087-98a1-ace523b77072 with identifier: AY24824
2026-03-28 18:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df7eea43-18f8-5087-98a1-ace523b77072 with identifier: AY24824 to the API
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY24824>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:27Z',
 'fuel_type': 'diesel',
 'id': 'df7eea43-18f8-5087-98a1-ace523b77072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY24824',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 41095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_b9e6798c00cb1f9141b511b87fde57c4.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_22a23768f6677919d559e8a6772d423e.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_051d940f98f72123cda755962f8acc17.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_6a2415576e247f1007b79622fbda1c53.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_ef67fda0983ccfb405bf9e98fba4bc18.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_7e12e5cb6103f85879a0af1168072eef.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_d7129676cb6cbc6fa8037fb2b870c24f.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_9b851c7e95962a403a69e967f5c37e41.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_83cf7103d4b7b2a158a9bcc1dc8829b6.jpg',
                'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_cb6c99821866aa2cbdb4f18e2d0127cb.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_b9e6798c00cb1f9141b511b87fde57c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65642,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_22a23768f6677919d559e8a6772d423e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_051d940f98f72123cda755962f8acc17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_6a2415576e247f1007b79622fbda1c53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_ef67fda0983ccfb405bf9e98fba4bc18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_7e12e5cb6103f85879a0af1168072eef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_d7129676cb6cbc6fa8037fb2b870c24f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_9b851c7e95962a403a69e967f5c37e41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_83cf7103d4b7b2a158a9bcc1dc8829b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df7eea43-18f8-5087-98a1-ace523b77072/df7eea43-18f8-5087-98a1-ace523b77072_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img23/b6/23b67edc2908d1818a2a1f90bae943e3/pa/AY24824_cb6c99821866aa2cbdb4f18e2d0127cb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-11',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2022}
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY24824%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [auto1.de] INFO: Saving data for AY24824: {'created_time': 1774723272.916644, 'last_price_update_time': 1774723272.916655, 'auction_closing_time': 1774883787.0}
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY24824') HTTP/1.1" 204 0
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_da853f9e81db93c7bf5523fa15d74d10.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_4c4a0791f0cf0c279a675be9957e3bcb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_fcdcb91e141f928b91bee931d2094d42.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_fcdcb91e141f928b91bee931d2094d42.jpg not downloaded yet
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_986c9f822ce3033a85057f6843f55413.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_986c9f822ce3033a85057f6843f55413.jpg not downloaded yet
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_24d4dc6ac1018ec7d5f219bf5274ea67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_24d4dc6ac1018ec7d5f219bf5274ea67.jpg not downloaded yet
2026-03-28 18:41:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1f050>
2026-03-28 18:41:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_0bae9d89185cb218408bc5698e41e168.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_0bae9d89185cb218408bc5698e41e168.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb05d10>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_c27ba9aa56480fa8a8e4b0f303b9f313.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_c27ba9aa56480fa8a8e4b0f303b9f313.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb55050>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_8430822e134c6e54920612c27a095ec1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_8430822e134c6e54920612c27a095ec1.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_3388d6c12af84398b7bbca62707e00da.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_95b3bb88509158df5eca923c63ac5cdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_600bf0b93a1b1b7cd7e2d10f713676fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_128918009c1349ab3c4300b42f438828.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR70011/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_582c549752449c3ebd90e6bf2f9f6c5b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_582c549752449c3ebd90e6bf2f9f6c5b.jpg not downloaded yet
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_b9b26f24255484cf94a6f96ef41d249a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_b9b26f24255484cf94a6f96ef41d249a.jpg not downloaded yet
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_330d3746b98f0e6a0d74edd2280101ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_330d3746b98f0e6a0d74edd2280101ed.jpg not downloaded yet
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP26052> (referer: https://www.auto1.com/v1/car-details-view/YP26052/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ60429> (referer: https://www.auto1.com/v1/car-details-view/WJ60429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b053990>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_11d7201eae26cdd3a3e43e375ca59431.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_11d7201eae26cdd3a3e43e375ca59431.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65e0557a-8cdf-5bff-9598-937c1ff5035a
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd52490>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_5502cf07e45e3ed90287742d1d5f9508.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_5502cf07e45e3ed90287742d1d5f9508.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 425fc81b-d65b-5987-8573-82251aa0380b
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b162910>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_4fa1c44e19ba63b405dcc74b4ba7787a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_4fa1c44e19ba63b405dcc74b4ba7787a.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 425fc81b-d65b-5987-8573-82251aa0380b
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_7d5ad6df6e7e199315fdad5ff6763f4b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_7d5ad6df6e7e199315fdad5ff6763f4b.jpg not downloaded yet
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_0a7dd7b0549c8bbe10b95b1d74dac645.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_0a7dd7b0549c8bbe10b95b1d74dac645.jpg not downloaded yet
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_2dde2d6cd6b10156e4ab37ca3edb2f0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_2dde2d6cd6b10156e4ab37ca3edb2f0c.jpg not downloaded yet
2026-03-28 18:41:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb23310>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_da853f9e81db93c7bf5523fa15d74d10.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_da853f9e81db93c7bf5523fa15d74d10.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe3150>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_4c4a0791f0cf0c279a675be9957e3bcb.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_4c4a0791f0cf0c279a675be9957e3bcb.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65e0557a-8cdf-5bff-9598-937c1ff5035a
2026-03-28 18:41:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b023290>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_3388d6c12af84398b7bbca62707e00da.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_3388d6c12af84398b7bbca62707e00da.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe1b50>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_95b3bb88509158df5eca923c63ac5cdd.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_95b3bb88509158df5eca923c63ac5cdd.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65e0557a-8cdf-5bff-9598-937c1ff5035a
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a8f10>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_600bf0b93a1b1b7cd7e2d10f713676fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_600bf0b93a1b1b7cd7e2d10f713676fb.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 425fc81b-d65b-5987-8573-82251aa0380b
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd37950>
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_128918009c1349ab3c4300b42f438828.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_128918009c1349ab3c4300b42f438828.jpg saved to cache
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 425fc81b-d65b-5987-8573-82251aa0380b
2026-03-28 18:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5539d343-1aec-5424-a45e-26822f0bb2f3 with identifier: YP26052
2026-03-28 18:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5539d343-1aec-5424-a45e-26822f0bb2f3 with scrape type 1
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_7f5a81ecdae43355d474aecbfec251d2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_7f5a81ecdae43355d474aecbfec251d2.jpg not downloaded yet
2026-03-28 18:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c073683-26a7-5db9-ae59-5d7f2759724b with identifier: WJ60429
2026-03-28 18:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c073683-26a7-5db9-ae59-5d7f2759724b with scrape type 1
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_96e7a85fe474b88624830f3f4ad7372d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_96e7a85fe474b88624830f3f4ad7372d.jpg not downloaded yet
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_db7f6b0035347df98176f4b9900717cb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_db7f6b0035347df98176f4b9900717cb.jpg not downloaded yet
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_0546b3813319f0c25c83faab9b306f98.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_0546b3813319f0c25c83faab9b306f98.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_1cf1f501b1408941946edfb9472c2758.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_1cf1f501b1408941946edfb9472c2758.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_6ab70d1f2e87e40293f23d7e3703b51a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_6ab70d1f2e87e40293f23d7e3703b51a.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_430acc6b206792a1add3d58c6983d1a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_430acc6b206792a1add3d58c6983d1a7.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_2c696bac20f145818954b99bf54a756b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_2c696bac20f145818954b99bf54a756b.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_5e7f5558ea5d8330b81003e07771032a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_5e7f5558ea5d8330b81003e07771032a.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_e3ebd8c9666ded2d054bc018a4a2fbad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_e3ebd8c9666ded2d054bc018a4a2fbad.jpg not downloaded yet
2026-03-28 18:41:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_573b7c5df68937446232dd524c5e7320.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_573b7c5df68937446232dd524c5e7320.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_5dcea51dea40ba9760ad47f70958214a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_5dcea51dea40ba9760ad47f70958214a.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_3f67bd7b66401ca69368db41317383b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_3f67bd7b66401ca69368db41317383b9.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_231a7aad74118d6427da61689b469e9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_231a7aad74118d6427da61689b469e9d.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_02f83b5b76f875c47d2e18242e4fecf9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_02f83b5b76f875c47d2e18242e4fecf9.jpg not downloaded yet
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW25069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR40985/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_af0f3c8908897ca81ff05a9afc98c1a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_af0f3c8908897ca81ff05a9afc98c1a7.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_457f70d1a17922442bac9d76085ae801.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_457f70d1a17922442bac9d76085ae801.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_ae5828f4486451999a87826e9f96d3e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_ae5828f4486451999a87826e9f96d3e9.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_5260519762a224cf9678ac5a1923a532.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_5260519762a224cf9678ac5a1923a532.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_5b8ad3fa8a4fef641c70125b1baead4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_5b8ad3fa8a4fef641c70125b1baead4d.jpg not downloaded yet
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_2dde2d6cd6b10156e4ab37ca3edb2f0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_0d6deddfd52056418f74ff1694314d0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_0d6deddfd52056418f74ff1694314d0d.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_2bdc0bf6e26bae35aef75ce5ee686762.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_2bdc0bf6e26bae35aef75ce5ee686762.jpg not downloaded yet
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_0a7dd7b0549c8bbe10b95b1d74dac645.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_238368dcfdc5ad7e9ec29a93ec418b0a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_238368dcfdc5ad7e9ec29a93ec418b0a.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_7088f69ed9e530539212f7212301e722.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_7088f69ed9e530539212f7212301e722.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_1e1e0e14cc699f05402d780106a5cdc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_1e1e0e14cc699f05402d780106a5cdc3.jpg not downloaded yet
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_7d5ad6df6e7e199315fdad5ff6763f4b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_77984ebb55a6d73952e95204f8a755cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_77984ebb55a6d73952e95204f8a755cd.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_616633b315096bee8a0504f2fcdb6787.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_616633b315096bee8a0504f2fcdb6787.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_2b9a72a914aab86453fd1543453b24a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_2b9a72a914aab86453fd1543453b24a6.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_c0d6fd7bc9b4f1e24152d60d60bbf43c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_c0d6fd7bc9b4f1e24152d60d60bbf43c.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_773f4e021afb6ce713a9b4d8d885194b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_773f4e021afb6ce713a9b4d8d885194b.jpg not downloaded yet
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_330d3746b98f0e6a0d74edd2280101ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_20d4e5f8dece9eb1d03b50486b3d0664.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_20d4e5f8dece9eb1d03b50486b3d0664.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_dca5406c53edf0643fcff84f8e0078a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_dca5406c53edf0643fcff84f8e0078a3.jpg not downloaded yet
2026-03-28 18:41:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbda550>
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_2dde2d6cd6b10156e4ab37ca3edb2f0c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_2dde2d6cd6b10156e4ab37ca3edb2f0c.jpg saved to cache
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_5a7809efead3edaf9aac777a7ca5bdfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_5a7809efead3edaf9aac777a7ca5bdfb.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_c0386c7fcbf4244bd54633e5fa2aa84e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_c0386c7fcbf4244bd54633e5fa2aa84e.jpg not downloaded yet
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0da90>
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_0a7dd7b0549c8bbe10b95b1d74dac645.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_0a7dd7b0549c8bbe10b95b1d74dac645.jpg saved to cache
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_b9b26f24255484cf94a6f96ef41d249a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_1b976a8e9d0ce56e031f46f3e739ad73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_1b976a8e9d0ce56e031f46f3e739ad73.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_dcb93bc36acd60b719663ae9935e564a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_dcb93bc36acd60b719663ae9935e564a.jpg not downloaded yet
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb41750>
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_7d5ad6df6e7e199315fdad5ff6763f4b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_7d5ad6df6e7e199315fdad5ff6763f4b.jpg saved to cache
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_24d4dc6ac1018ec7d5f219bf5274ea67.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_582c549752449c3ebd90e6bf2f9f6c5b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b180b90>
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_330d3746b98f0e6a0d74edd2280101ed.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_330d3746b98f0e6a0d74edd2280101ed.jpg saved to cache
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_8d5859b06d953d208deb2fa58d98f585.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_8d5859b06d953d208deb2fa58d98f585.jpg not downloaded yet
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_402cf0af8fbea63c9b01bb7432e94780.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_402cf0af8fbea63c9b01bb7432e94780.jpg not downloaded yet
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beb3e90>
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_b9b26f24255484cf94a6f96ef41d249a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_b9b26f24255484cf94a6f96ef41d249a.jpg saved to cache
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b028d10>
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_24d4dc6ac1018ec7d5f219bf5274ea67.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_24d4dc6ac1018ec7d5f219bf5274ea67.jpg saved to cache
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb30a10>
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_582c549752449c3ebd90e6bf2f9f6c5b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_582c549752449c3ebd90e6bf2f9f6c5b.jpg saved to cache
2026-03-28 18:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_5dcea51dea40ba9760ad47f70958214a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_1cf1f501b1408941946edfb9472c2758.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_0546b3813319f0c25c83faab9b306f98.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_96e7a85fe474b88624830f3f4ad7372d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_db7f6b0035347df98176f4b9900717cb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_573b7c5df68937446232dd524c5e7320.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_7f5a81ecdae43355d474aecbfec251d2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_457f70d1a17922442bac9d76085ae801.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b017790>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_5dcea51dea40ba9760ad47f70958214a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_5dcea51dea40ba9760ad47f70958214a.jpg saved to cache
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1d4e90>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_1cf1f501b1408941946edfb9472c2758.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_1cf1f501b1408941946edfb9472c2758.jpg saved to cache
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b075ed0>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_0546b3813319f0c25c83faab9b306f98.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_0546b3813319f0c25c83faab9b306f98.jpg saved to cache
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b58be4cd0>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_96e7a85fe474b88624830f3f4ad7372d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_96e7a85fe474b88624830f3f4ad7372d.jpg saved to cache
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b076010>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_db7f6b0035347df98176f4b9900717cb.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_db7f6b0035347df98176f4b9900717cb.jpg saved to cache
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b29bf50>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_573b7c5df68937446232dd524c5e7320.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_573b7c5df68937446232dd524c5e7320.jpg saved to cache
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0779d0>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_7f5a81ecdae43355d474aecbfec251d2.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_7f5a81ecdae43355d474aecbfec251d2.jpg saved to cache
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbda250>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_457f70d1a17922442bac9d76085ae801.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_457f70d1a17922442bac9d76085ae801.jpg saved to cache
2026-03-28 18:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_2bdc0bf6e26bae35aef75ce5ee686762.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_402cf0af8fbea63c9b01bb7432e94780.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR70011> (referer: https://www.auto1.com/v1/car-details-view/WR70011/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR40985> (referer: https://www.auto1.com/v1/car-details-view/TR40985/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZX35580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_c0386c7fcbf4244bd54633e5fa2aa84e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_dca5406c53edf0643fcff84f8e0078a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_5a7809efead3edaf9aac777a7ca5bdfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_0d6deddfd52056418f74ff1694314d0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b25e990>
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_2bdc0bf6e26bae35aef75ce5ee686762.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_2bdc0bf6e26bae35aef75ce5ee686762.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b01b1d0>
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_402cf0af8fbea63c9b01bb7432e94780.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_402cf0af8fbea63c9b01bb7432e94780.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_20d4e5f8dece9eb1d03b50486b3d0664.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_dcb93bc36acd60b719663ae9935e564a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_1b976a8e9d0ce56e031f46f3e739ad73.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with identifier: WR70011
2026-03-28 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with scrape type 1
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_d1888e69940bddad45bea0e033fe118b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_d1888e69940bddad45bea0e033fe118b.jpg not downloaded yet
2026-03-28 18:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02492eb5-9c6c-5a28-b81b-88d205d51ffe with identifier: TR40985
2026-03-28 18:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe with scrape type 1
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_bf9b818d603f69612db601d3f8c49599.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_bf9b818d603f69612db601d3f8c49599.jpg not downloaded yet
2026-03-28 18:41:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf1dd0>
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_c0386c7fcbf4244bd54633e5fa2aa84e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_c0386c7fcbf4244bd54633e5fa2aa84e.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb9f9d0>
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_dca5406c53edf0643fcff84f8e0078a3.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_dca5406c53edf0643fcff84f8e0078a3.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b055090>
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_5a7809efead3edaf9aac777a7ca5bdfb.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_5a7809efead3edaf9aac777a7ca5bdfb.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb64bd0>
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_0d6deddfd52056418f74ff1694314d0d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_0d6deddfd52056418f74ff1694314d0d.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_0b378b96507eb94ffa22ff31e4355a48.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_0b378b96507eb94ffa22ff31e4355a48.jpg not downloaded yet
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_0c973031a9be100485ae75e3e14b5f03.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_0c973031a9be100485ae75e3e14b5f03.jpg not downloaded yet
2026-03-28 18:41:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_e491ae559e0660f65d362af17cf628ee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_e491ae559e0660f65d362af17cf628ee.jpg not downloaded yet
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_d10874ef7ae22ef57be237074b18fee2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_d10874ef7ae22ef57be237074b18fee2.jpg not downloaded yet
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd57650>
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_20d4e5f8dece9eb1d03b50486b3d0664.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_20d4e5f8dece9eb1d03b50486b3d0664.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1ca710>
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_dcb93bc36acd60b719663ae9935e564a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_dcb93bc36acd60b719663ae9935e564a.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b25f0d0>
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_1b976a8e9d0ce56e031f46f3e739ad73.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_1b976a8e9d0ce56e031f46f3e739ad73.jpg saved to cache
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_7088f69ed9e530539212f7212301e722.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_1e1e0e14cc699f05402d780106a5cdc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_83da3b4c0b01b8facbc56b6ef3a32a82.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_83da3b4c0b01b8facbc56b6ef3a32a82.jpg not downloaded yet
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_85e8c8b622dd61fcdc30b2782e8cf6c1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_85e8c8b622dd61fcdc30b2782e8cf6c1.jpg not downloaded yet
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_a27feaff52bb6ac07d9697dcf08e2972.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_a27feaff52bb6ac07d9697dcf08e2972.jpg not downloaded yet
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_0f9ecc68870a1f02c5527c3bf866680f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_0f9ecc68870a1f02c5527c3bf866680f.jpg not downloaded yet
2026-03-28 18:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_77984ebb55a6d73952e95204f8a755cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_534f34b1d003a083d32ea2c49100204b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_534f34b1d003a083d32ea2c49100204b.jpg not downloaded yet
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_c4e4be580e8bc4660b2d6f35b3a3d033.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_c4e4be580e8bc4660b2d6f35b3a3d033.jpg not downloaded yet
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_bf9b818d603f69612db601d3f8c49599.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_238368dcfdc5ad7e9ec29a93ec418b0a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_4ffcb089ef3aa3cca6da50478bdede97.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_4ffcb089ef3aa3cca6da50478bdede97.jpg not downloaded yet
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_f2332201fed2a91c12de83e73e548efb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_f2332201fed2a91c12de83e73e548efb.jpg not downloaded yet
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be46c90>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_7088f69ed9e530539212f7212301e722.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_7088f69ed9e530539212f7212301e722.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd89d90>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_1e1e0e14cc699f05402d780106a5cdc3.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_1e1e0e14cc699f05402d780106a5cdc3.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_34c2898addcfdb6e28cad3f60086954e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_34c2898addcfdb6e28cad3f60086954e.jpg not downloaded yet
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_bb2d19b5c9ba3d49a3eca87bc1606f0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_bb2d19b5c9ba3d49a3eca87bc1606f0d.jpg not downloaded yet
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_d1888e69940bddad45bea0e033fe118b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_972547c93a4b31d3d88fcdb59d84c7c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_972547c93a4b31d3d88fcdb59d84c7c0.jpg not downloaded yet
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_daa7903c0daee96d16b5a89a6c92e1a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_daa7903c0daee96d16b5a89a6c92e1a8.jpg not downloaded yet
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_9255a460eec83ff495cdadc939cca9d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_9255a460eec83ff495cdadc939cca9d4.jpg not downloaded yet
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_3a7ce2b86d7116723ce9235b4d8549e9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_3a7ce2b86d7116723ce9235b4d8549e9.jpg not downloaded yet
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b034650>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_77984ebb55a6d73952e95204f8a755cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_77984ebb55a6d73952e95204f8a755cd.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be69150>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_bf9b818d603f69612db601d3f8c49599.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_bf9b818d603f69612db601d3f8c49599.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbbb650>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_238368dcfdc5ad7e9ec29a93ec418b0a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_238368dcfdc5ad7e9ec29a93ec418b0a.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_5b8ad3fa8a4fef641c70125b1baead4d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_5260519762a224cf9678ac5a1923a532.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc1d290>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_d1888e69940bddad45bea0e033fe118b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_d1888e69940bddad45bea0e033fe118b.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_ae5828f4486451999a87826e9f96d3e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_e491ae559e0660f65d362af17cf628ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_d10874ef7ae22ef57be237074b18fee2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_8d5859b06d953d208deb2fa58d98f585.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_773f4e021afb6ce713a9b4d8d885194b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_2b9a72a914aab86453fd1543453b24a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_c0d6fd7bc9b4f1e24152d60d60bbf43c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_616633b315096bee8a0504f2fcdb6787.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW25069> (referer: https://www.auto1.com/v1/car-details-view/BW25069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b183f90>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_5b8ad3fa8a4fef641c70125b1baead4d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_5b8ad3fa8a4fef641c70125b1baead4d.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_c4e4be580e8bc4660b2d6f35b3a3d033.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_0f9ecc68870a1f02c5527c3bf866680f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_534f34b1d003a083d32ea2c49100204b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59cf5450>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_5260519762a224cf9678ac5a1923a532.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_5260519762a224cf9678ac5a1923a532.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_9255a460eec83ff495cdadc939cca9d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_bb2d19b5c9ba3d49a3eca87bc1606f0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bddd150>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_ae5828f4486451999a87826e9f96d3e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_ae5828f4486451999a87826e9f96d3e9.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0026d0>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_e491ae559e0660f65d362af17cf628ee.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_e491ae559e0660f65d362af17cf628ee.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c3550>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_d10874ef7ae22ef57be237074b18fee2.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_d10874ef7ae22ef57be237074b18fee2.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb38d0>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_8d5859b06d953d208deb2fa58d98f585.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_8d5859b06d953d208deb2fa58d98f585.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c1d90>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_773f4e021afb6ce713a9b4d8d885194b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_773f4e021afb6ce713a9b4d8d885194b.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1123d0>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_2b9a72a914aab86453fd1543453b24a6.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_2b9a72a914aab86453fd1543453b24a6.jpg saved to cache
2026-03-28 18:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb06fd0>
2026-03-28 18:41:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_c0d6fd7bc9b4f1e24152d60d60bbf43c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_c0d6fd7bc9b4f1e24152d60d60bbf43c.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c1390>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_616633b315096bee8a0504f2fcdb6787.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_616633b315096bee8a0504f2fcdb6787.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with identifier: BW25069
2026-03-28 18:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with scrape type 1
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_7c9b39eed9e19aba4c807051668926ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_7c9b39eed9e19aba4c807051668926ac.jpg not downloaded yet
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZX35580> (referer: https://www.auto1.com/v1/car-details-view/ZX35580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_9f8d17be4fc5eeb938f554f0a9a811b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_9f8d17be4fc5eeb938f554f0a9a811b0.jpg not downloaded yet
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd14cd0>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_c4e4be580e8bc4660b2d6f35b3a3d033.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_c4e4be580e8bc4660b2d6f35b3a3d033.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be45e90>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_0f9ecc68870a1f02c5527c3bf866680f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_0f9ecc68870a1f02c5527c3bf866680f.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b034d90>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_534f34b1d003a083d32ea2c49100204b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_534f34b1d003a083d32ea2c49100204b.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd585d0>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_9255a460eec83ff495cdadc939cca9d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_9255a460eec83ff495cdadc939cca9d4.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b037910>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_bb2d19b5c9ba3d49a3eca87bc1606f0d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_bb2d19b5c9ba3d49a3eca87bc1606f0d.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_6b5edf977c67b684c115657dab76d669.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_6b5edf977c67b684c115657dab76d669.jpg not downloaded yet
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_2a3c8862a4f2df90010dc164fd3c0de4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_2a3c8862a4f2df90010dc164fd3c0de4.jpg not downloaded yet
2026-03-28 18:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fde70115-3e56-5bf9-82e0-fce4acf2b7ab with identifier: ZX35580
2026-03-28 18:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab with scrape type 1
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_9fcba1d3141389ba2fb4d4208cd82ac2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_9fcba1d3141389ba2fb4d4208cd82ac2.jpg not downloaded yet
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_85e8c8b622dd61fcdc30b2782e8cf6c1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_2ef99e408ab2eec6d37d3be148cd60c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_2ef99e408ab2eec6d37d3be148cd60c2.jpg not downloaded yet
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_34c2898addcfdb6e28cad3f60086954e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_4ffcb089ef3aa3cca6da50478bdede97.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_022cdab4dd2de81d863e24a970f7ba6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_022cdab4dd2de81d863e24a970f7ba6d.jpg not downloaded yet
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_61b6f91f5aa474529f0bb3955b13b6e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_61b6f91f5aa474529f0bb3955b13b6e1.jpg not downloaded yet
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_45d6174930cef29b321631caef4a43b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_45d6174930cef29b321631caef4a43b8.jpg not downloaded yet
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_b4bed0daf6d2a3e86ba153950d8c47ca.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_b4bed0daf6d2a3e86ba153950d8c47ca.jpg not downloaded yet
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_0b378b96507eb94ffa22ff31e4355a48.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_83da3b4c0b01b8facbc56b6ef3a32a82.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_0c973031a9be100485ae75e3e14b5f03.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_edbae7dcbdd1fe051fa11b616eb13ef5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_edbae7dcbdd1fe051fa11b616eb13ef5.jpg not downloaded yet
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_e21a1a9f55472a94a6369df9738b3771.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_e21a1a9f55472a94a6369df9738b3771.jpg not downloaded yet
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_6166287a9895a6ba833b1f36317b3678.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_6166287a9895a6ba833b1f36317b3678.jpg not downloaded yet
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb3810>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_85e8c8b622dd61fcdc30b2782e8cf6c1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_85e8c8b622dd61fcdc30b2782e8cf6c1.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_06e7baa2047e4f921df09a69b54b7219.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_06e7baa2047e4f921df09a69b54b7219.jpg not downloaded yet
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd6ad10>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_34c2898addcfdb6e28cad3f60086954e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_34c2898addcfdb6e28cad3f60086954e.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2eeb90>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_4ffcb089ef3aa3cca6da50478bdede97.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_4ffcb089ef3aa3cca6da50478bdede97.jpg saved to cache
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_02f83b5b76f875c47d2e18242e4fecf9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_231a7aad74118d6427da61689b469e9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_dbb559bae060bb91b9f525fe0b9b9667.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_dbb559bae060bb91b9f525fe0b9b9667.jpg not downloaded yet
2026-03-28 18:41:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_af0f3c8908897ca81ff05a9afc98c1a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2ef210>
2026-03-28 18:41:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_0b378b96507eb94ffa22ff31e4355a48.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_0b378b96507eb94ffa22ff31e4355a48.jpg saved to cache
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5b6eecd0>
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_83da3b4c0b01b8facbc56b6ef3a32a82.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_83da3b4c0b01b8facbc56b6ef3a32a82.jpg saved to cache
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be46590>
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_0c973031a9be100485ae75e3e14b5f03.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_0c973031a9be100485ae75e3e14b5f03.jpg saved to cache
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_393fa4466219b5b53ea8cdf44b87897e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_393fa4466219b5b53ea8cdf44b87897e.jpg not downloaded yet
2026-03-28 18:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_972547c93a4b31d3d88fcdb59d84c7c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_3f67bd7b66401ca69368db41317383b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beed450>
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_02f83b5b76f875c47d2e18242e4fecf9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_02f83b5b76f875c47d2e18242e4fecf9.jpg saved to cache
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be89e10>
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_231a7aad74118d6427da61689b469e9d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_231a7aad74118d6427da61689b469e9d.jpg saved to cache
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb36fd0>
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_af0f3c8908897ca81ff05a9afc98c1a7.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_af0f3c8908897ca81ff05a9afc98c1a7.jpg saved to cache
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_9fcba1d3141389ba2fb4d4208cd82ac2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_7c9b39eed9e19aba4c807051668926ac.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_daa7903c0daee96d16b5a89a6c92e1a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b184290>
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_972547c93a4b31d3d88fcdb59d84c7c0.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_972547c93a4b31d3d88fcdb59d84c7c0.jpg saved to cache
2026-03-28 18:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10ce10>
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_3f67bd7b66401ca69368db41317383b9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_3f67bd7b66401ca69368db41317383b9.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_2a3c8862a4f2df90010dc164fd3c0de4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_b4bed0daf6d2a3e86ba153950d8c47ca.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_3a7ce2b86d7116723ce9235b4d8549e9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_45d6174930cef29b321631caef4a43b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_6b5edf977c67b684c115657dab76d669.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b014f90>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_9fcba1d3141389ba2fb4d4208cd82ac2.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_9fcba1d3141389ba2fb4d4208cd82ac2.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd7af50>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_7c9b39eed9e19aba4c807051668926ac.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_7c9b39eed9e19aba4c807051668926ac.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0
2026-03-28 18:41:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bde44d0>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_daa7903c0daee96d16b5a89a6c92e1a8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_daa7903c0daee96d16b5a89a6c92e1a8.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_f2332201fed2a91c12de83e73e548efb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_61b6f91f5aa474529f0bb3955b13b6e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_06e7baa2047e4f921df09a69b54b7219.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b035090>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_2a3c8862a4f2df90010dc164fd3c0de4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_2a3c8862a4f2df90010dc164fd3c0de4.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b210850>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_b4bed0daf6d2a3e86ba153950d8c47ca.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_b4bed0daf6d2a3e86ba153950d8c47ca.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05af90>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_3a7ce2b86d7116723ce9235b4d8549e9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_3a7ce2b86d7116723ce9235b4d8549e9.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b057c10>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_45d6174930cef29b321631caef4a43b8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_45d6174930cef29b321631caef4a43b8.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b035c10>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_6b5edf977c67b684c115657dab76d669.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_6b5edf977c67b684c115657dab76d669.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_6166287a9895a6ba833b1f36317b3678.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_e21a1a9f55472a94a6369df9738b3771.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_edbae7dcbdd1fe051fa11b616eb13ef5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_393fa4466219b5b53ea8cdf44b87897e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_dbb559bae060bb91b9f525fe0b9b9667.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_022cdab4dd2de81d863e24a970f7ba6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_2ef99e408ab2eec6d37d3be148cd60c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_a27feaff52bb6ac07d9697dcf08e2972.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b021650>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf7%252Fe2%252Ff7e2030f973c560ef510d8c424b455d9%252Fpa%252FTR40985_f2332201fed2a91c12de83e73e548efb.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_f2332201fed2a91c12de83e73e548efb.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe
2026-03-28 18:41:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02492eb5-9c6c-5a28-b81b-88d205d51ffe, skipping ID generation
2026-03-28 18:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe with scrape type 1
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02492eb5-9c6c-5a28-b81b-88d205d51ffe sending to next pipeline
2026-03-28 18:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02492eb5-9c6c-5a28-b81b-88d205d51ffe, identifier: TR40985
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a0ae8d0>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_61b6f91f5aa474529f0bb3955b13b6e1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_61b6f91f5aa474529f0bb3955b13b6e1.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b189f90>
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_06e7baa2047e4f921df09a69b54b7219.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_06e7baa2047e4f921df09a69b54b7219.jpg saved to cache
2026-03-28 18:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02492eb5-9c6c-5a28-b81b-88d205d51ffe with identifier: TR40985
2026-03-28 18:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02492eb5-9c6c-5a28-b81b-88d205d51ffe with identifier: TR40985
2026-03-28 18:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02492eb5-9c6c-5a28-b81b-88d205d51ffe with identifier: TR40985 to the API
2026-03-28 18:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_f2332201fed2a91c12de83e73e548efb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:35:51Z',
 'fuel_type': 'diesel',
 'id': '02492eb5-9c6c-5a28-b81b-88d205d51ffe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR40985',
 'listing': 'auction',
 'location': 'DE, Buchholz',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 127242,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_bf9b818d603f69612db601d3f8c49599.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_0c973031a9be100485ae75e3e14b5f03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_d10874ef7ae22ef57be237074b18fee2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_85e8c8b622dd61fcdc30b2782e8cf6c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_0f9ecc68870a1f02c5527c3bf866680f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71495,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_c4e4be580e8bc4660b2d6f35b3a3d033.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2538217,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_f2332201fed2a91c12de83e73e548efb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_bb2d19b5c9ba3d49a3eca87bc1606f0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2517984,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_daa7903c0daee96d16b5a89a6c92e1a8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02492eb5-9c6c-5a28-b81b-88d205d51ffe/02492eb5-9c6c-5a28-b81b-88d205d51ffe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2512027,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf7/e2/f7e2030f973c560ef510d8c424b455d9/pa/TR40985_3a7ce2b86d7116723ce9235b4d8549e9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi BeChic',
 'transmission': 'automatic',
 'trim': 'BeChic',
 'year': 2018}
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR40985%27 HTTP/1.1" 200 None
2026-03-28 18:41:21 [auto1.de] INFO: Saving data for TR40985: {'created_time': 1774723281.195022, 'last_price_update_time': 1774723281.195033, 'auction_closing_time': 1774884951.0}
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR40985') HTTP/1.1" 204 0
2026-03-28 18:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_986c9f822ce3033a85057f6843f55413.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_9f8d17be4fc5eeb938f554f0a9a811b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_2c696bac20f145818954b99bf54a756b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_430acc6b206792a1add3d58c6983d1a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10cd10>
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_6166287a9895a6ba833b1f36317b3678.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_6166287a9895a6ba833b1f36317b3678.jpg saved to cache
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b180550>
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_e21a1a9f55472a94a6369df9738b3771.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_e21a1a9f55472a94a6369df9738b3771.jpg saved to cache
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b000c90>
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_edbae7dcbdd1fe051fa11b616eb13ef5.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_edbae7dcbdd1fe051fa11b616eb13ef5.jpg saved to cache
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1040d0>
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_393fa4466219b5b53ea8cdf44b87897e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_393fa4466219b5b53ea8cdf44b87897e.jpg saved to cache
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb656d0>
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_dbb559bae060bb91b9f525fe0b9b9667.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_dbb559bae060bb91b9f525fe0b9b9667.jpg saved to cache
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b183310>
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg97%252Fdb%252F97dbb658fed052eaad463017d9770e08%252Fpa%252FZX35580_022cdab4dd2de81d863e24a970f7ba6d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_022cdab4dd2de81d863e24a970f7ba6d.jpg saved to cache
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab
2026-03-28 18:41:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fde70115-3e56-5bf9-82e0-fce4acf2b7ab, skipping ID generation
2026-03-28 18:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab with scrape type 1
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fde70115-3e56-5bf9-82e0-fce4acf2b7ab sending to next pipeline
2026-03-28 18:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fde70115-3e56-5bf9-82e0-fce4acf2b7ab, identifier: ZX35580
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc20f10>
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_2ef99e408ab2eec6d37d3be148cd60c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_2ef99e408ab2eec6d37d3be148cd60c2.jpg saved to cache
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0
2026-03-28 18:41:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b297790>
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252Fa4%252F1aa4c31353e106dbee8c153fe41728a0%252Fpa%252FWR70011_a27feaff52bb6ac07d9697dcf08e2972.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_a27feaff52bb6ac07d9697dcf08e2972.jpg saved to cache
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec
2026-03-28 18:41:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec, skipping ID generation
2026-03-28 18:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with scrape type 1
2026-03-28 18:41:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b1b07b7-f96a-56f6-97e6-d9999465f9ec sending to next pipeline
2026-03-28 18:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec, identifier: WR70011
2026-03-28 18:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fde70115-3e56-5bf9-82e0-fce4acf2b7ab with identifier: ZX35580
2026-03-28 18:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fde70115-3e56-5bf9-82e0-fce4acf2b7ab with identifier: ZX35580
2026-03-28 18:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fde70115-3e56-5bf9-82e0-fce4acf2b7ab with identifier: ZX35580 to the API
2026-03-28 18:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_022cdab4dd2de81d863e24a970f7ba6d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:48Z',
 'fuel_type': 'diesel',
 'id': 'fde70115-3e56-5bf9-82e0-fce4acf2b7ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX35580',
 'listing': 'auction',
 'location': 'DE, Aurich',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 141116,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_9fcba1d3141389ba2fb4d4208cd82ac2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_022cdab4dd2de81d863e24a970f7ba6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_45d6174930cef29b321631caef4a43b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53554,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_b4bed0daf6d2a3e86ba153950d8c47ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_edbae7dcbdd1fe051fa11b616eb13ef5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_e21a1a9f55472a94a6369df9738b3771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_6166287a9895a6ba833b1f36317b3678.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_06e7baa2047e4f921df09a69b54b7219.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70246,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_dbb559bae060bb91b9f525fe0b9b9667.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fde70115-3e56-5bf9-82e0-fce4acf2b7ab/fde70115-3e56-5bf9-82e0-fce4acf2b7ab_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img97/db/97dbb658fed052eaad463017d9770e08/pa/ZX35580_393fa4466219b5b53ea8cdf44b87897e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2016}
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX35580%27 HTTP/1.1" 200 None
2026-03-28 18:41:22 [auto1.de] INFO: Saving data for ZX35580: {'created_time': 1774723282.255512, 'last_price_update_time': 1774723282.255524, 'auction_closing_time': 1774885188.0}
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX35580') HTTP/1.1" 204 0
2026-03-28 18:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with identifier: WR70011
2026-03-28 18:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with identifier: WR70011
2026-03-28 18:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b1b07b7-f96a-56f6-97e6-d9999465f9ec with identifier: WR70011 to the API
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_a27feaff52bb6ac07d9697dcf08e2972.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 259,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 3',
 'engine': '2.7L',
 'engine_horse_power': 228,
 'expiration_date': '2026-03-30T15:01:22Z',
 'fuel_type': 'petrol',
 'id': '0b1b07b7-f96a-56f6-97e6-d9999465f9ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR70011',
 'listing': 'auction',
 'location': 'DE, Donaueschingen',
 'make': 'Porsche',
 'model': 'Boxster',
 'odometer': 71145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_d1888e69940bddad45bea0e033fe118b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_0b378b96507eb94ffa22ff31e4355a48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71382,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_e491ae559e0660f65d362af17cf628ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_83da3b4c0b01b8facbc56b6ef3a32a82.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2459523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_a27feaff52bb6ac07d9697dcf08e2972.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_534f34b1d003a083d32ea2c49100204b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_4ffcb089ef3aa3cca6da50478bdede97.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_34c2898addcfdb6e28cad3f60086954e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2259300,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_972547c93a4b31d3d88fcdb59d84c7c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b1b07b7-f96a-56f6-97e6-d9999465f9ec/0b1b07b7-f96a-56f6-97e6-d9999465f9ec_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/a4/1aa4c31353e106dbee8c153fe41728a0/pa/WR70011_9255a460eec83ff495cdadc939cca9d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Porsche Boxster 2.7',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-28 18:41:22 [auto1.de] INFO: Saving data for WR70011: {'created_time': 1774723282.631493, 'last_price_update_time': 1774723282.631508, 'auction_closing_time': 1774882882.0}
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR70011') HTTP/1.1" 204 0
2026-03-28 18:41:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_15a5b9d463673ddc72e9a040750644b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b294890>
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_986c9f822ce3033a85057f6843f55413.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_986c9f822ce3033a85057f6843f55413.jpg saved to cache
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb012d0>
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252Fce%252F8bcedc78928a8623ab91ba0986dd4c19%252Fpa%252FBW25069_9f8d17be4fc5eeb938f554f0a9a811b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_9f8d17be4fc5eeb938f554f0a9a811b0.jpg saved to cache
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0
2026-03-28 18:41:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0, skipping ID generation
2026-03-28 18:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with scrape type 1
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 sending to next pipeline
2026-03-28 18:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0, identifier: BW25069
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd5a6d0>
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_2c696bac20f145818954b99bf54a756b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_2c696bac20f145818954b99bf54a756b.jpg saved to cache
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb03b90>
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fd4%252F6cd4d3a25418f993a960fe98558fb6ad%252Fpa%252FWJ60429_430acc6b206792a1add3d58c6983d1a7.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_430acc6b206792a1add3d58c6983d1a7.jpg saved to cache
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c073683-26a7-5db9-ae59-5d7f2759724b
2026-03-28 18:41:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c073683-26a7-5db9-ae59-5d7f2759724b, skipping ID generation
2026-03-28 18:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c073683-26a7-5db9-ae59-5d7f2759724b with scrape type 1
2026-03-28 18:41:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c073683-26a7-5db9-ae59-5d7f2759724b sending to next pipeline
2026-03-28 18:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c073683-26a7-5db9-ae59-5d7f2759724b, identifier: WJ60429
2026-03-28 18:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_9425e3e0810424d9a5939cd89457c2d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_def8a0f9e578ea998099d3a45b9f54bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with identifier: BW25069
2026-03-28 18:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with identifier: BW25069
2026-03-28 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0 with identifier: BW25069 to the API
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_9f8d17be4fc5eeb938f554f0a9a811b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:46:35Z',
 'fuel_type': 'petrol',
 'id': '0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW25069',
 'listing': 'auction',
 'location': 'DE, Saarbrücken',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 121017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94103,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_7c9b39eed9e19aba4c807051668926ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_9f8d17be4fc5eeb938f554f0a9a811b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_6b5edf977c67b684c115657dab76d669.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_2a3c8862a4f2df90010dc164fd3c0de4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_2ef99e408ab2eec6d37d3be148cd60c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0/0dc680f0-a3c3-5abd-9805-1bfd1b4c55a0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/ce/8bcedc78928a8623ab91ba0986dd4c19/pa/BW25069_61b6f91f5aa474529f0bb3955b13b6e1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW25069%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Saving data for BW25069: {'created_time': 1774723283.428287, 'last_price_update_time': 1774723283.428298, 'auction_closing_time': 1774885595.0}
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW25069') HTTP/1.1" 204 0
2026-03-28 18:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c073683-26a7-5db9-ae59-5d7f2759724b with identifier: WJ60429
2026-03-28 18:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c073683-26a7-5db9-ae59-5d7f2759724b with identifier: WJ60429
2026-03-28 18:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c073683-26a7-5db9-ae59-5d7f2759724b with identifier: WJ60429 to the API
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_430acc6b206792a1add3d58c6983d1a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:17:06Z',
 'fuel_type': 'diesel',
 'id': '8c073683-26a7-5db9-ae59-5d7f2759724b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ60429',
 'listing': 'auction',
 'location': 'DE, Regensburg',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 54020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3320310,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_96e7a85fe474b88624830f3f4ad7372d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_430acc6b206792a1add3d58c6983d1a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_5dcea51dea40ba9760ad47f70958214a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_457f70d1a17922442bac9d76085ae801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76653,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_2bdc0bf6e26bae35aef75ce5ee686762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3186429,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_616633b315096bee8a0504f2fcdb6787.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3150869,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_dca5406c53edf0643fcff84f8e0078a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3191335,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_c0386c7fcbf4244bd54633e5fa2aa84e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_dcb93bc36acd60b719663ae9935e564a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c073683-26a7-5db9-ae59-5d7f2759724b/8c073683-26a7-5db9-ae59-5d7f2759724b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/d4/6cd4d3a25418f993a960fe98558fb6ad/pa/WJ60429_402cf0af8fbea63c9b01bb7432e94780.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Laurin & Klement 4x4',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement 4x4',
 'year': 2019}
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ60429%27 HTTP/1.1" 200 None
2026-03-28 18:41:23 [auto1.de] INFO: Saving data for WJ60429: {'created_time': 1774723283.807505, 'last_price_update_time': 1774723283.807516, 'auction_closing_time': 1774883826.0}
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ60429') HTTP/1.1" 204 0
2026-03-28 18:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_b3ed01712444b37866a7d3c60f32d99f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10abd0>
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_15a5b9d463673ddc72e9a040750644b1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_15a5b9d463673ddc72e9a040750644b1.jpg saved to cache
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c4e10>
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_9425e3e0810424d9a5939cd89457c2d1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_9425e3e0810424d9a5939cd89457c2d1.jpg saved to cache
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17f110>
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_def8a0f9e578ea998099d3a45b9f54bf.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_def8a0f9e578ea998099d3a45b9f54bf.jpg saved to cache
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 425fc81b-d65b-5987-8573-82251aa0380b
2026-03-28 18:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_9bbdcd3b6a7b0d87cc2c58d50c284ca9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_53bed0a5af9ac21da0893fc632ba0b16.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beff210>
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_b3ed01712444b37866a7d3c60f32d99f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_b3ed01712444b37866a7d3c60f32d99f.jpg saved to cache
2026-03-28 18:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65e0557a-8cdf-5bff-9598-937c1ff5035a
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ad955995d89f91796dcb946e0a650a69.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_5e7f5558ea5d8330b81003e07771032a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_e3ebd8c9666ded2d054bc018a4a2fbad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_ebe6a3ee14ee2c93dfc40142eaa8a325.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_6ab70d1f2e87e40293f23d7e3703b51a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_fcdcb91e141f928b91bee931d2094d42.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_71d59870a25162400cabae78f4939755.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbecd90>
2026-03-28 18:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc4%252F7c%252Fc47c394e613b2a395be654e3abd30909%252Fpa%252FLM31898_9bbdcd3b6a7b0d87cc2c58d50c284ca9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_9bbdcd3b6a7b0d87cc2c58d50c284ca9.jpg saved to cache
2026-03-28 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 425fc81b-d65b-5987-8573-82251aa0380b
2026-03-28 18:41:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 425fc81b-d65b-5987-8573-82251aa0380b, skipping ID generation
2026-03-28 18:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 425fc81b-d65b-5987-8573-82251aa0380b with scrape type 1
2026-03-28 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 425fc81b-d65b-5987-8573-82251aa0380b sending to next pipeline
2026-03-28 18:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 425fc81b-d65b-5987-8573-82251aa0380b, identifier: LM31898
2026-03-28 18:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 425fc81b-d65b-5987-8573-82251aa0380b with identifier: LM31898
2026-03-28 18:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 425fc81b-d65b-5987-8573-82251aa0380b with identifier: LM31898
2026-03-28 18:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 425fc81b-d65b-5987-8573-82251aa0380b with identifier: LM31898 to the API
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_9bbdcd3b6a7b0d87cc2c58d50c284ca9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:14Z',
 'fuel_type': 'petrol',
 'id': '425fc81b-d65b-5987-8573-82251aa0380b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM31898',
 'listing': 'auction',
 'location': 'DE, Singen',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 235661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89375,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_9bbdcd3b6a7b0d87cc2c58d50c284ca9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_def8a0f9e578ea998099d3a45b9f54bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_600bf0b93a1b1b7cd7e2d10f713676fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_128918009c1349ab3c4300b42f438828.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_5502cf07e45e3ed90287742d1d5f9508.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_425fc81b-d65b-5987-8573-82251aa0380b/425fc81b-d65b-5987-8573-82251aa0380b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc4/7c/c47c394e613b2a395be654e3abd30909/pa/LM31898_4fa1c44e19ba63b405dcc74b4ba7787a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-01-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2007}
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM31898%27 HTTP/1.1" 200 None
2026-03-28 18:41:24 [auto1.de] INFO: Saving data for LM31898: {'created_time': 1774723284.583523, 'last_price_update_time': 1774723284.583539, 'auction_closing_time': 1774885874.0}
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM31898') HTTP/1.1" 204 0
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_42d656f254fcfd100994d1a6162e3e3c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_a80c37e95732003882590ddb21265c6c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d0d90>
2026-03-28 18:41:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252F35%252F6d35a0ffe96abaf9b84b58366b3fa508%252Fpa%252FZA78506_53bed0a5af9ac21da0893fc632ba0b16.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_53bed0a5af9ac21da0893fc632ba0b16.jpg saved to cache
2026-03-28 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65e0557a-8cdf-5bff-9598-937c1ff5035a
2026-03-28 18:41:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65e0557a-8cdf-5bff-9598-937c1ff5035a, skipping ID generation
2026-03-28 18:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65e0557a-8cdf-5bff-9598-937c1ff5035a with scrape type 1
2026-03-28 18:41:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65e0557a-8cdf-5bff-9598-937c1ff5035a sending to next pipeline
2026-03-28 18:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65e0557a-8cdf-5bff-9598-937c1ff5035a, identifier: ZA78506
2026-03-28 18:41:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_2842a0a51f60ab5cb5a88d032abf0561.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65e0557a-8cdf-5bff-9598-937c1ff5035a with identifier: ZA78506
2026-03-28 18:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65e0557a-8cdf-5bff-9598-937c1ff5035a with identifier: ZA78506
2026-03-28 18:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65e0557a-8cdf-5bff-9598-937c1ff5035a with identifier: ZA78506 to the API
2026-03-28 18:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_53bed0a5af9ac21da0893fc632ba0b16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:06:49Z',
 'fuel_type': 'petrol',
 'id': '65e0557a-8cdf-5bff-9598-937c1ff5035a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA78506',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 273923,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_53bed0a5af9ac21da0893fc632ba0b16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_b3ed01712444b37866a7d3c60f32d99f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_11d7201eae26cdd3a3e43e375ca59431.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_95b3bb88509158df5eca923c63ac5cdd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65e0557a-8cdf-5bff-9598-937c1ff5035a/65e0557a-8cdf-5bff-9598-937c1ff5035a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 154776,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/35/6d35a0ffe96abaf9b84b58366b3fa508/pa/ZA78506_4c4a0791f0cf0c279a675be9957e3bcb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-01-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA78506%27 HTTP/1.1" 200 None
2026-03-28 18:41:25 [auto1.de] INFO: Saving data for ZA78506: {'created_time': 1774723285.160164, 'last_price_update_time': 1774723285.160177, 'auction_closing_time': 1774883209.0}
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA78506') HTTP/1.1" 204 0
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd34d90>
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge1%252Fc7%252Fe1c7b79424e6ad0910187f3fa1625f40%252Fpa%252FJB16135_ad955995d89f91796dcb946e0a650a69.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ad955995d89f91796dcb946e0a650a69.jpg saved to cache
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b22321c4-a09d-5a78-9987-c4a825a27d1e
2026-03-28 18:41:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b22321c4-a09d-5a78-9987-c4a825a27d1e, skipping ID generation
2026-03-28 18:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b22321c4-a09d-5a78-9987-c4a825a27d1e with scrape type 1
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b22321c4-a09d-5a78-9987-c4a825a27d1e sending to next pipeline
2026-03-28 18:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b22321c4-a09d-5a78-9987-c4a825a27d1e, identifier: JB16135
2026-03-28 18:41:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3df50>
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_5e7f5558ea5d8330b81003e07771032a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_5e7f5558ea5d8330b81003e07771032a.jpg saved to cache
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3c690>
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc8%252Fbf%252Fc8bf37f0683f44fefc3c7fed46855f5e%252Fpa%252FEL78604_e3ebd8c9666ded2d054bc018a4a2fbad.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_e3ebd8c9666ded2d054bc018a4a2fbad.jpg saved to cache
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5
2026-03-28 18:41:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5, skipping ID generation
2026-03-28 18:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with scrape type 1
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 sending to next pipeline
2026-03-28 18:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5, identifier: EL78604
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bde5850>
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_ebe6a3ee14ee2c93dfc40142eaa8a325.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_ebe6a3ee14ee2c93dfc40142eaa8a325.jpg saved to cache
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbf89d0>
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Ffa%252F5efa87e710040c02a3174e72097b4d62%252Fpa%252FYP26052_6ab70d1f2e87e40293f23d7e3703b51a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_6ab70d1f2e87e40293f23d7e3703b51a.jpg saved to cache
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5539d343-1aec-5424-a45e-26822f0bb2f3
2026-03-28 18:41:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5539d343-1aec-5424-a45e-26822f0bb2f3, skipping ID generation
2026-03-28 18:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5539d343-1aec-5424-a45e-26822f0bb2f3 with scrape type 1
2026-03-28 18:41:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5539d343-1aec-5424-a45e-26822f0bb2f3 sending to next pipeline
2026-03-28 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5539d343-1aec-5424-a45e-26822f0bb2f3, identifier: YP26052
2026-03-28 18:41:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbf8cd0>
2026-03-28 18:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252Fdf%252Ff3dff34128a235bf1ec2c53ce76d4bf5%252Fpa%252FWX17645_fcdcb91e141f928b91bee931d2094d42.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_fcdcb91e141f928b91bee931d2094d42.jpg saved to cache
2026-03-28 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9acdd69d-6d7e-5b5b-a082-be29a8806632
2026-03-28 18:41:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9acdd69d-6d7e-5b5b-a082-be29a8806632, skipping ID generation
2026-03-28 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9acdd69d-6d7e-5b5b-a082-be29a8806632 with scrape type 1
2026-03-28 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9acdd69d-6d7e-5b5b-a082-be29a8806632 sending to next pipeline
2026-03-28 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9acdd69d-6d7e-5b5b-a082-be29a8806632, identifier: WX17645
2026-03-28 18:41:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05bd90>
2026-03-28 18:41:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F66%252F3e66a0a09f9cc8d990222b607441e715%252Fpa%252FGJ73585_71d59870a25162400cabae78f4939755.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_71d59870a25162400cabae78f4939755.jpg saved to cache
2026-03-28 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7
2026-03-28 18:41:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7, skipping ID generation
2026-03-28 18:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with scrape type 1
2026-03-28 18:41:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 sending to next pipeline
2026-03-28 18:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7, identifier: GJ73585
2026-03-28 18:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b22321c4-a09d-5a78-9987-c4a825a27d1e with identifier: JB16135
2026-03-28 18:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b22321c4-a09d-5a78-9987-c4a825a27d1e with identifier: JB16135
2026-03-28 18:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b22321c4-a09d-5a78-9987-c4a825a27d1e with identifier: JB16135 to the API
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ad955995d89f91796dcb946e0a650a69.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:02:29Z',
 'fuel_type': 'petrol',
 'id': 'b22321c4-a09d-5a78-9987-c4a825a27d1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB16135',
 'listing': 'auction',
 'location': 'DE, Elmshorn',
 'make': 'Volkswagen',
 'model': 'Beetle',
 'odometer': 64802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75066,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ad955995d89f91796dcb946e0a650a69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2962909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_da853f9e81db93c7bf5523fa15d74d10.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3016628,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_3388d6c12af84398b7bbca62707e00da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_5eea66877728dc23f45bfaf30505d576.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_ff2309c709a97d30fed5fbacf1ae20f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_74de83e4ee07005b2de1cc7ffa6f19be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_23bdcd42896db981d5812d5784f7439f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_89b9c51dec0238cf0724ad206e3d18f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_734079f697c9d865f399469426240244.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b22321c4-a09d-5a78-9987-c4a825a27d1e/b22321c4-a09d-5a78-9987-c4a825a27d1e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2838581,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge1/c7/e1c7b79424e6ad0910187f3fa1625f40/pa/JB16135_c54d15620de64b841b92383020f6e6ce.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Beetle 1.2 TSI Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2013}
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB16135%27 HTTP/1.1" 200 None
2026-03-28 18:41:26 [auto1.de] INFO: Saving data for JB16135: {'created_time': 1774723286.834484, 'last_price_update_time': 1774723286.834496, 'auction_closing_time': 1774882949.0}
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB16135') HTTP/1.1" 204 0
2026-03-28 18:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with identifier: EL78604
2026-03-28 18:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with identifier: EL78604
2026-03-28 18:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5 with identifier: EL78604 to the API
2026-03-28 18:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_e3ebd8c9666ded2d054bc018a4a2fbad.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:40:48Z',
 'fuel_type': 'petrol',
 'id': 'c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL78604',
 'listing': 'auction',
 'location': 'DE, Nürnberg',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 28444,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_15a5b9d463673ddc72e9a040750644b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_24d4dc6ac1018ec7d5f219bf5274ea67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_330d3746b98f0e6a0d74edd2280101ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_2dde2d6cd6b10156e4ab37ca3edb2f0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878663,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_1cf1f501b1408941946edfb9472c2758.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2966114,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_e3ebd8c9666ded2d054bc018a4a2fbad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_02f83b5b76f875c47d2e18242e4fecf9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98330,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_5b8ad3fa8a4fef641c70125b1baead4d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_1e1e0e14cc699f05402d780106a5cdc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5/c2eceb2d-f0a0-540a-9ad5-74bcb907b2a5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2532598,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc8/bf/c8bf37f0683f44fefc3c7fed46855f5e/pa/EL78604_773f4e021afb6ce713a9b4d8d885194b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Rio 1.2 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2016}
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL78604%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Saving data for EL78604: {'created_time': 1774723287.253133, 'last_price_update_time': 1774723287.253144, 'auction_closing_time': 1774885248.0}
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL78604') HTTP/1.1" 204 0
2026-03-28 18:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5539d343-1aec-5424-a45e-26822f0bb2f3 with identifier: YP26052
2026-03-28 18:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5539d343-1aec-5424-a45e-26822f0bb2f3 with identifier: YP26052
2026-03-28 18:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5539d343-1aec-5424-a45e-26822f0bb2f3 with identifier: YP26052 to the API
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_6ab70d1f2e87e40293f23d7e3703b51a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 77,
 'expiration_date': '2026-03-30T15:51:47Z',
 'fuel_type': 'petrol',
 'id': '5539d343-1aec-5424-a45e-26822f0bb2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP26052',
 'listing': 'auction',
 'location': 'DE, Augsburg',
 'make': 'Fiat',
 'model': 'Qubo',
 'odometer': 40068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3426550,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_7f5a81ecdae43355d474aecbfec251d2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3073650,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_6ab70d1f2e87e40293f23d7e3703b51a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_573b7c5df68937446232dd524c5e7320.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_af0f3c8908897ca81ff05a9afc98c1a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3006598,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_0d6deddfd52056418f74ff1694314d0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_77984ebb55a6d73952e95204f8a755cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_20d4e5f8dece9eb1d03b50486b3d0664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3165406,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_5a7809efead3edaf9aac777a7ca5bdfb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82749,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_1b976a8e9d0ce56e031f46f3e739ad73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5539d343-1aec-5424-a45e-26822f0bb2f3/5539d343-1aec-5424-a45e-26822f0bb2f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2751069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/fa/5efa87e710040c02a3174e72097b4d62/pa/YP26052_8d5859b06d953d208deb2fa58d98f585.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-01',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Qubo 1.4 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP26052%27 HTTP/1.1" 200 None
2026-03-28 18:41:27 [auto1.de] INFO: Saving data for YP26052: {'created_time': 1774723287.624808, 'last_price_update_time': 1774723287.624822, 'auction_closing_time': 1774885907.0}
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP26052') HTTP/1.1" 204 0
2026-03-28 18:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9acdd69d-6d7e-5b5b-a082-be29a8806632 with identifier: WX17645
2026-03-28 18:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9acdd69d-6d7e-5b5b-a082-be29a8806632 with identifier: WX17645
2026-03-28 18:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9acdd69d-6d7e-5b5b-a082-be29a8806632 with identifier: WX17645 to the API
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_fcdcb91e141f928b91bee931d2094d42.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.6L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:14:20Z',
 'fuel_type': 'petrol',
 'id': '9acdd69d-6d7e-5b5b-a082-be29a8806632',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX17645',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 116988,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_9425e3e0810424d9a5939cd89457c2d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3140153,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_fcdcb91e141f928b91bee931d2094d42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_582c549752449c3ebd90e6bf2f9f6c5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_7d5ad6df6e7e199315fdad5ff6763f4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3271467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_db7f6b0035347df98176f4b9900717cb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86657,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_2c696bac20f145818954b99bf54a756b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_3f67bd7b66401ca69368db41317383b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_ae5828f4486451999a87826e9f96d3e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91000,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_238368dcfdc5ad7e9ec29a93ec418b0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9acdd69d-6d7e-5b5b-a082-be29a8806632/9acdd69d-6d7e-5b5b-a082-be29a8806632_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750423,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/df/f3dff34128a235bf1ec2c53ce76d4bf5/pa/WX17645_2b9a72a914aab86453fd1543453b24a6.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-03-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 240 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX17645%27 HTTP/1.1" 200 None
2026-03-28 18:41:28 [auto1.de] INFO: Saving data for WX17645: {'created_time': 1774723288.026362, 'last_price_update_time': 1774723288.026378, 'auction_closing_time': 1774883660.0}
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX17645') HTTP/1.1" 204 0
2026-03-28 18:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with identifier: GJ73585
2026-03-28 18:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with identifier: GJ73585
2026-03-28 18:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7 with identifier: GJ73585 to the API
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_71d59870a25162400cabae78f4939755.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:41:12Z',
 'fuel_type': 'diesel',
 'id': 'e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ73585',
 'listing': 'auction',
 'location': 'DE, Cottbus',
 'make': 'BMW',
 'model': '3er',
 'odometer': 217309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2915551,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_71d59870a25162400cabae78f4939755.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_986c9f822ce3033a85057f6843f55413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_b9b26f24255484cf94a6f96ef41d249a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_0a7dd7b0549c8bbe10b95b1d74dac645.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836660,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_0546b3813319f0c25c83faab9b306f98.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2880394,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_5e7f5558ea5d8330b81003e07771032a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_231a7aad74118d6427da61689b469e9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_5260519762a224cf9678ac5a1923a532.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_7088f69ed9e530539212f7212301e722.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7/e77e2aec-9dbb-5fa1-87c9-90a619ea0cd7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3101931,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/66/3e66a0a09f9cc8d990222b607441e715/pa/GJ73585_c0d6fd7bc9b4f1e24152d60d60bbf43c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ73585%27 HTTP/1.1" 200 None
2026-03-28 18:41:28 [auto1.de] INFO: Saving data for GJ73585: {'created_time': 1774723288.412204, 'last_price_update_time': 1774723288.412216, 'auction_closing_time': 1774885272.0}
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ73585') HTTP/1.1" 204 0
2026-03-28 18:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ER27214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT42092/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bce6110>
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_42d656f254fcfd100994d1a6162e3e3c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_42d656f254fcfd100994d1a6162e3e3c.jpg saved to cache
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcf2010>
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_a80c37e95732003882590ddb21265c6c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_a80c37e95732003882590ddb21265c6c.jpg saved to cache
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b2590>
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_2842a0a51f60ab5cb5a88d032abf0561.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_2842a0a51f60ab5cb5a88d032abf0561.jpg saved to cache
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_7450e013c48678b980597375bd2efc30.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_174722c2cc3094b9f2199b896493ad5d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_881b6df66f8cea1c030ab15da3da8a9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_db5aaa5ef74bddd283f1595676c8c3e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b204990>
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F62%252F036299a0b646d8ad145b3e3328abc1de%252Fpa%252FUS66744_7450e013c48678b980597375bd2efc30.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_7450e013c48678b980597375bd2efc30.jpg saved to cache
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54315052-af72-57db-b053-c7b4de7fa63d
2026-03-28 18:41:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54315052-af72-57db-b053-c7b4de7fa63d, skipping ID generation
2026-03-28 18:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54315052-af72-57db-b053-c7b4de7fa63d with scrape type 1
2026-03-28 18:41:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54315052-af72-57db-b053-c7b4de7fa63d sending to next pipeline
2026-03-28 18:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 54315052-af72-57db-b053-c7b4de7fa63d, identifier: US66744
2026-03-28 18:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 54315052-af72-57db-b053-c7b4de7fa63d with identifier: US66744
2026-03-28 18:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 54315052-af72-57db-b053-c7b4de7fa63d with identifier: US66744
2026-03-28 18:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 54315052-af72-57db-b053-c7b4de7fa63d with identifier: US66744 to the API
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_7450e013c48678b980597375bd2efc30.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:20:12Z',
 'fuel_type': 'petrol',
 'id': '54315052-af72-57db-b053-c7b4de7fa63d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US66744',
 'listing': 'auction',
 'location': 'DE, Geldern',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 73348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2295523,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_21bc0b18fed4ffb048fa911a2a0a4312.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2284891,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_7450e013c48678b980597375bd2efc30.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_a80c37e95732003882590ddb21265c6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_42d656f254fcfd100994d1a6162e3e3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_cba80cf8ed8dd14fbf5f3676e7885633.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2237415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_8430822e134c6e54920612c27a095ec1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_f4c96281d2b8e59934c7d3c8d060c505.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_9c0f4f51ff87375843a3747b206f6b41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2291752,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_c27ba9aa56480fa8a8e4b0f303b9f313.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54315052-af72-57db-b053-c7b4de7fa63d/54315052-af72-57db-b053-c7b4de7fa63d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2303862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img03/62/036299a0b646d8ad145b3e3328abc1de/pa/US66744_0bae9d89185cb218408bc5698e41e168.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2015}
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US66744%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [auto1.de] INFO: Saving data for US66744: {'created_time': 1774723289.342264, 'last_price_update_time': 1774723289.342279, 'auction_closing_time': 1774884012.0}
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US66744') HTTP/1.1" 204 0
2026-03-28 18:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_a433cdad2dc2d06b16440ed76018d850.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_6af11414da5644d528dbfaf6fde0d92f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_fefdc08e44829822d4986c8a488d947d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL01555> (referer: https://www.auto1.com/v1/car-details-view/HL01555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF23268> (referer: https://www.auto1.com/v1/car-details-view/GF23268/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0a650>
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_174722c2cc3094b9f2199b896493ad5d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_174722c2cc3094b9f2199b896493ad5d.jpg saved to cache
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d28b90>
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_881b6df66f8cea1c030ab15da3da8a9e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_881b6df66f8cea1c030ab15da3da8a9e.jpg saved to cache
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd69e50>
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_db5aaa5ef74bddd283f1595676c8c3e1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_db5aaa5ef74bddd283f1595676c8c3e1.jpg saved to cache
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b237550>
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_a433cdad2dc2d06b16440ed76018d850.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_a433cdad2dc2d06b16440ed76018d850.jpg saved to cache
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0e250>
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_6af11414da5644d528dbfaf6fde0d92f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_6af11414da5644d528dbfaf6fde0d92f.jpg saved to cache
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b076c50>
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_fefdc08e44829822d4986c8a488d947d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_fefdc08e44829822d4986c8a488d947d.jpg saved to cache
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb
2026-03-28 18:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with identifier: HL01555
2026-03-28 18:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with scrape type 1
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_6e1fca5ca149a0259c02e29123cb0f1c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_6e1fca5ca149a0259c02e29123cb0f1c.jpg not downloaded yet
2026-03-28 18:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87a44eab-d965-53e9-8713-c9d1119b1bbe with identifier: GF23268
2026-03-28 18:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a44eab-d965-53e9-8713-c9d1119b1bbe with scrape type 1
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_4765b1c9671fe2749ca5c67594f2d7bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_4765b1c9671fe2749ca5c67594f2d7bb.jpg not downloaded yet
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_ca432e5b6f221732fa3a9d63193a80f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_ca432e5b6f221732fa3a9d63193a80f0.jpg not downloaded yet
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_eb1d2f6b4be15dcaba7566b9d58a2aab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_eb1d2f6b4be15dcaba7566b9d58a2aab.jpg not downloaded yet
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_582803613550e3b8c2b434ddc80100a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_582803613550e3b8c2b434ddc80100a1.jpg not downloaded yet
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_d3a83104521441f97ab42e4ed336790f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_d3a83104521441f97ab42e4ed336790f.jpg not downloaded yet
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_91491957822ea6f3ea18e1b7e7a37eee.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_91491957822ea6f3ea18e1b7e7a37eee.jpg not downloaded yet
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_824299475b200e9aa187ef41bdb5d46b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_824299475b200e9aa187ef41bdb5d46b.jpg not downloaded yet
2026-03-28 18:41:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_51f7b79e88fb316befba4ee2864a2949.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_77a24ee79f6999f3c9ba69001fa4dcd8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_77a24ee79f6999f3c9ba69001fa4dcd8.jpg not downloaded yet
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_23984b5190af106d572a765836aaf722.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_23984b5190af106d572a765836aaf722.jpg not downloaded yet
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_6d8521ff5775c2479be144bd470f39fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_6d8521ff5775c2479be144bd470f39fe.jpg not downloaded yet
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_9c27be70869858bc21996ad00bf30623.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_9c27be70869858bc21996ad00bf30623.jpg not downloaded yet
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_7aaa87d65cbedcd42f30674a672382d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_7aaa87d65cbedcd42f30674a672382d7.jpg not downloaded yet
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_1a6409c01daf06f0ede0ffe7a8f4ac62.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_1a6409c01daf06f0ede0ffe7a8f4ac62.jpg not downloaded yet
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_cf27b87c307a65ba4086ab967e00b0c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_cf27b87c307a65ba4086ab967e00b0c2.jpg not downloaded yet
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b67979990>
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_51f7b79e88fb316befba4ee2864a2949.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_51f7b79e88fb316befba4ee2864a2949.jpg saved to cache
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb
2026-03-28 18:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_309d7cd0bb0b66ca79083806048098ee.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_88ff90726601cf5edc2fdea4c7a65b0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_9e9980a9a21b7c6b9851089859f93686.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_d3a83104521441f97ab42e4ed336790f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PB68045> (referer: https://www.auto1.com/v1/car-details-view/PB68045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fde2d0>
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_309d7cd0bb0b66ca79083806048098ee.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_309d7cd0bb0b66ca79083806048098ee.jpg saved to cache
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe6350>
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fe2%252Fbfe264db2ca1dabeeffec6ef7c405b68%252Fpa%252FAC64408_88ff90726601cf5edc2fdea4c7a65b0b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_88ff90726601cf5edc2fdea4c7a65b0b.jpg saved to cache
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0
2026-03-28 18:41:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0, skipping ID generation
2026-03-28 18:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with scrape type 1
2026-03-28 18:41:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 sending to next pipeline
2026-03-28 18:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0, identifier: AC64408
2026-03-28 18:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with identifier: AC64408
2026-03-28 18:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with identifier: AC64408
2026-03-28 18:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e11f052-e1b2-5459-ba6d-d58afbf34fa0 with identifier: AC64408 to the API
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_88ff90726601cf5edc2fdea4c7a65b0b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:00:39Z',
 'fuel_type': 'petrol',
 'id': '4e11f052-e1b2-5459-ba6d-d58afbf34fa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC64408',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 87272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_db5aaa5ef74bddd283f1595676c8c3e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_ba14cc2a9fce4e2130f741db2fbdadea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_d477b2ffa35564fe5561b4c6ad4cc104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2907862,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_309d7cd0bb0b66ca79083806048098ee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3083725,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_88ff90726601cf5edc2fdea4c7a65b0b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67211,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_c492ceedce07db3a0a73b5291f1ce98d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3105347,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_881b6df66f8cea1c030ab15da3da8a9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_2842a0a51f60ab5cb5a88d032abf0561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3108197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_174722c2cc3094b9f2199b896493ad5d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e11f052-e1b2-5459-ba6d-d58afbf34fa0/4e11f052-e1b2-5459-ba6d-d58afbf34fa0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/e2/bfe264db2ca1dabeeffec6ef7c405b68/pa/AC64408_ebe6a3ee14ee2c93dfc40142eaa8a325.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 108 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC64408%27 HTTP/1.1" 200 None
2026-03-28 18:41:30 [auto1.de] INFO: Saving data for AC64408: {'created_time': 1774723290.988465, 'last_price_update_time': 1774723290.988477, 'auction_closing_time': 1774882839.0}
2026-03-28 18:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC64408') HTTP/1.1" 204 0
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC60426/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX47236/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT42092> (referer: https://www.auto1.com/v1/car-details-view/XT42092/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WJ67055> (referer: https://www.auto1.com/v1/car-details-view/WJ67055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UZ60031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b000050>
2026-03-28 18:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_9e9980a9a21b7c6b9851089859f93686.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_9e9980a9a21b7c6b9851089859f93686.jpg saved to cache
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:41:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b072190>
2026-03-28 18:41:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_d3a83104521441f97ab42e4ed336790f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_d3a83104521441f97ab42e4ed336790f.jpg saved to cache
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16a542e1-48b3-5226-965f-880ef1002860 with identifier: PB68045
2026-03-28 18:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a542e1-48b3-5226-965f-880ef1002860 with scrape type 1
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_cc9d29b6581dda7c035d6451f02401b3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_cc9d29b6581dda7c035d6451f02401b3.jpg not downloaded yet
2026-03-28 18:41:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VE13678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ER27214> (referer: https://www.auto1.com/v1/car-details-view/ER27214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_fcbcf3bf9725b86a98b4c8852ec05017.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_fcbcf3bf9725b86a98b4c8852ec05017.jpg not downloaded yet
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_4a62496747ef5b595beaa2f2ce57c158.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_4a62496747ef5b595beaa2f2ce57c158.jpg not downloaded yet
2026-03-28 18:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d2803ca-911b-5581-9411-59cbdfc1346b with identifier: XT42092
2026-03-28 18:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2803ca-911b-5581-9411-59cbdfc1346b with scrape type 1
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_080ff723c46845b6937831c02805f9d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_080ff723c46845b6937831c02805f9d1.jpg not downloaded yet
2026-03-28 18:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9267e4cd-1859-50b4-9544-4eabf4720173 with identifier: WJ67055
2026-03-28 18:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9267e4cd-1859-50b4-9544-4eabf4720173 with scrape type 1
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9267e4cd-1859-50b4-9544-4eabf4720173
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_b9753c1aa18d88fbab8732240e16fb8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_b9753c1aa18d88fbab8732240e16fb8a.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_565d6e91dd36a11a5e3e99b20e43281b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_565d6e91dd36a11a5e3e99b20e43281b.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_bae6dfd265cbc2293d9a0e20122c4cd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_bae6dfd265cbc2293d9a0e20122c4cd1.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_fa9d3910dfa24d307f1049a22955c579.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_fa9d3910dfa24d307f1049a22955c579.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_9acf81b367172de80bf46dd1eb2d4cb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_9acf81b367172de80bf46dd1eb2d4cb7.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_fb0c543f98024d8ca0fd6430d5998ddc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_fb0c543f98024d8ca0fd6430d5998ddc.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_c66e3c2f3643b9620f45a13de4b64282.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_c66e3c2f3643b9620f45a13de4b64282.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_07aee5958b9645111b28025789f73fcc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_07aee5958b9645111b28025789f73fcc.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_385452bf79e172a6cc877a55243a3d53.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_385452bf79e172a6cc877a55243a3d53.jpg already downloaded
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252F6c%252F066c70edc8937396ee863d8691a69ffa%252Fpa%252FWJ67055_0af38ae7a3d525e365e417031f75dbcd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_0af38ae7a3d525e365e417031f75dbcd.jpg already downloaded
2026-03-28 18:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9267e4cd-1859-50b4-9544-4eabf4720173, identifier: WJ67055
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_e29094ab6c9e956f696bfedcdc5c41b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_e29094ab6c9e956f696bfedcdc5c41b8.jpg not downloaded yet
2026-03-28 18:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9267e4cd-1859-50b4-9544-4eabf4720173 with identifier: WJ67055
2026-03-28 18:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9267e4cd-1859-50b4-9544-4eabf4720173 with identifier: WJ67055
2026-03-28 18:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9267e4cd-1859-50b4-9544-4eabf4720173 with identifier: WJ67055 to the API
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WJ67055>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.7L',
 'engine_horse_power': 334,
 'expiration_date': '2026-03-30T15:36:47Z',
 'fuel_type': 'petrol',
 'id': '9267e4cd-1859-50b4-9544-4eabf4720173',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ67055',
 'listing': 'auction',
 'location': 'DE, Kleve',
 'make': 'Ford',
 'model': 'Bronco',
 'odometer': 74045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_b9753c1aa18d88fbab8732240e16fb8a.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_565d6e91dd36a11a5e3e99b20e43281b.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_bae6dfd265cbc2293d9a0e20122c4cd1.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_fa9d3910dfa24d307f1049a22955c579.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_9acf81b367172de80bf46dd1eb2d4cb7.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_fb0c543f98024d8ca0fd6430d5998ddc.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_c66e3c2f3643b9620f45a13de4b64282.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_07aee5958b9645111b28025789f73fcc.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_385452bf79e172a6cc877a55243a3d53.jpg',
                'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_0af38ae7a3d525e365e417031f75dbcd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_b9753c1aa18d88fbab8732240e16fb8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_565d6e91dd36a11a5e3e99b20e43281b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_bae6dfd265cbc2293d9a0e20122c4cd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_fa9d3910dfa24d307f1049a22955c579.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_9acf81b367172de80bf46dd1eb2d4cb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3110494,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_fb0c543f98024d8ca0fd6430d5998ddc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2857333,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_c66e3c2f3643b9620f45a13de4b64282.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_07aee5958b9645111b28025789f73fcc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2888627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_385452bf79e172a6cc877a55243a3d53.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9267e4cd-1859-50b4-9544-4eabf4720173/9267e4cd-1859-50b4-9544-4eabf4720173_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/6c/066c70edc8937396ee863d8691a69ffa/pa/WJ67055_0af38ae7a3d525e365e417031f75dbcd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Bronco 2.7 EcoBoost Outer Banks 4x4',
 'transmission': 'automatic',
 'trim': 'Outer Banks 4x4',
 'year': 2022}
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67055%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [auto1.de] INFO: Saving data for WJ67055: {'created_time': 1774723291.939712, 'last_price_update_time': 1774723291.939724, 'auction_closing_time': 1774885007.0}
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ67055') HTTP/1.1" 204 0
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_1d2a0c6d85d17de2b1ef0f1e2c6ad879.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_1d2a0c6d85d17de2b1ef0f1e2c6ad879.jpg not downloaded yet
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_cc9d29b6581dda7c035d6451f02401b3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_6d8521ff5775c2479be144bd470f39fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_1a6409c01daf06f0ede0ffe7a8f4ac62.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_77a24ee79f6999f3c9ba69001fa4dcd8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_cf27b87c307a65ba4086ab967e00b0c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_85d0d8f4d259d140af37cc485930ec99.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_85d0d8f4d259d140af37cc485930ec99.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_a37dd8e8cb3e39df7a8065aec2c47989.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_a37dd8e8cb3e39df7a8065aec2c47989.jpg not downloaded yet
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RX22328/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with identifier: ER27214
2026-03-28 18:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with scrape type 1
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_3df508b67e7a58ac95b200de4c8fe744.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_3df508b67e7a58ac95b200de4c8fe744.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_83ac8630fedd46fcba6a7f7f850fae7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_83ac8630fedd46fcba6a7f7f850fae7d.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_d8fdae90fd77a936f06d29eb0de65f2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_d8fdae90fd77a936f06d29eb0de65f2f.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_619172fb0f46aca094ee7997670b4f7a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_619172fb0f46aca094ee7997670b4f7a.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_3359c4929b8f6769350b6e0d84c50d96.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_3359c4929b8f6769350b6e0d84c50d96.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_578cd8c4789859e11dfc287e3e2c7667.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_578cd8c4789859e11dfc287e3e2c7667.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_0b75f0e842d64436f8b9a62a03ea07cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_0b75f0e842d64436f8b9a62a03ea07cf.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_614dcdcd96f005f59e53a27bd08f9766.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_614dcdcd96f005f59e53a27bd08f9766.jpg not downloaded yet
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b189f50>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_cc9d29b6581dda7c035d6451f02401b3.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_cc9d29b6581dda7c035d6451f02401b3.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3fcd0>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_6d8521ff5775c2479be144bd470f39fe.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_6d8521ff5775c2479be144bd470f39fe.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbedc10>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_1a6409c01daf06f0ede0ffe7a8f4ac62.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_1a6409c01daf06f0ede0ffe7a8f4ac62.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3d710>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_77a24ee79f6999f3c9ba69001fa4dcd8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_77a24ee79f6999f3c9ba69001fa4dcd8.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda4b50>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_cf27b87c307a65ba4086ab967e00b0c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_cf27b87c307a65ba4086ab967e00b0c2.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_91491957822ea6f3ea18e1b7e7a37eee.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_e1d5c033965fd14b681b5518f278d380.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_e1d5c033965fd14b681b5518f278d380.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_37d45076f11fa80309b6dea54189df64.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_37d45076f11fa80309b6dea54189df64.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_736b24df723fe825e371f6cc8e33c9f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_736b24df723fe825e371f6cc8e33c9f9.jpg not downloaded yet
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_582803613550e3b8c2b434ddc80100a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_1d2a0c6d85d17de2b1ef0f1e2c6ad879.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_eb1d2f6b4be15dcaba7566b9d58a2aab.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_7320f47201237aa48ef194fda283d068.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_7320f47201237aa48ef194fda283d068.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_a5446da3d0e1be53ab9194d16427362e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_a5446da3d0e1be53ab9194d16427362e.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_e17bad8f1c33105fe1c5b8001e8e641c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_e17bad8f1c33105fe1c5b8001e8e641c.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_dea1a6db716052582b32988c9167d77c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_dea1a6db716052582b32988c9167d77c.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_7a0d484dc4cc476f4d0096829c4f0ed4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_7a0d484dc4cc476f4d0096829c4f0ed4.jpg not downloaded yet
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_e29094ab6c9e956f696bfedcdc5c41b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_ae9338ae1cb8c1090bf4be89fe8aba58.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_ae9338ae1cb8c1090bf4be89fe8aba58.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_8182eb150c693cde8672781dd4d0da54.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_8182eb150c693cde8672781dd4d0da54.jpg not downloaded yet
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_080ff723c46845b6937831c02805f9d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_0b75f0e842d64436f8b9a62a03ea07cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59cd3c50>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_91491957822ea6f3ea18e1b7e7a37eee.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_91491957822ea6f3ea18e1b7e7a37eee.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_32577c73f2754e3c4480b8c687c545d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_32577c73f2754e3c4480b8c687c545d4.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_b2aaf6b79421fbc58cb955bb94af17e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_b2aaf6b79421fbc58cb955bb94af17e1.jpg not downloaded yet
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_1db6fffacba700516ddd2fb5690b478e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_1db6fffacba700516ddd2fb5690b478e.jpg not downloaded yet
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb3150>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_582803613550e3b8c2b434ddc80100a1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_582803613550e3b8c2b434ddc80100a1.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe0a10>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_1d2a0c6d85d17de2b1ef0f1e2c6ad879.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_1d2a0c6d85d17de2b1ef0f1e2c6ad879.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ff6250>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_eb1d2f6b4be15dcaba7566b9d58a2aab.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_eb1d2f6b4be15dcaba7566b9d58a2aab.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_7c5c2cbe10bfa4805c7003d983ed01de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_7c5c2cbe10bfa4805c7003d983ed01de.jpg not downloaded yet
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb41810>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_e29094ab6c9e956f696bfedcdc5c41b8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_e29094ab6c9e956f696bfedcdc5c41b8.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_85d0d8f4d259d140af37cc485930ec99.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_614dcdcd96f005f59e53a27bd08f9766.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_e1d5c033965fd14b681b5518f278d380.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b006310>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_080ff723c46845b6937831c02805f9d1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_080ff723c46845b6937831c02805f9d1.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b070f10>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_0b75f0e842d64436f8b9a62a03ea07cf.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_0b75f0e842d64436f8b9a62a03ea07cf.jpg saved to cache
2026-03-28 18:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_e17bad8f1c33105fe1c5b8001e8e641c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd16450>
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_85d0d8f4d259d140af37cc485930ec99.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_85d0d8f4d259d140af37cc485930ec99.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_7aaa87d65cbedcd42f30674a672382d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_23984b5190af106d572a765836aaf722.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_7a0d484dc4cc476f4d0096829c4f0ed4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_1db6fffacba700516ddd2fb5690b478e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd17d10>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_614dcdcd96f005f59e53a27bd08f9766.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_614dcdcd96f005f59e53a27bd08f9766.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcd3d0>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_e1d5c033965fd14b681b5518f278d380.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_e1d5c033965fd14b681b5518f278d380.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_9c27be70869858bc21996ad00bf30623.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_dea1a6db716052582b32988c9167d77c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ82101> (referer: https://www.auto1.com/v1/car-details-view/GZ82101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WB83413> (referer: https://www.auto1.com/v1/car-details-view/WB83413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b150c50>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_e17bad8f1c33105fe1c5b8001e8e641c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_e17bad8f1c33105fe1c5b8001e8e641c.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:41:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbd7450>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_7aaa87d65cbedcd42f30674a672382d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_7aaa87d65cbedcd42f30674a672382d7.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe4e10>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_23984b5190af106d572a765836aaf722.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_23984b5190af106d572a765836aaf722.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10a590>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_7a0d484dc4cc476f4d0096829c4f0ed4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_7a0d484dc4cc476f4d0096829c4f0ed4.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7d650>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_1db6fffacba700516ddd2fb5690b478e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_1db6fffacba700516ddd2fb5690b478e.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:33 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_824299475b200e9aa187ef41bdb5d46b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:33 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14714%27 HTTP/1.1" 200 None
2026-03-28 18:41:33 [auto1.de] INFO: Scrape type for UH14714: 0
2026-03-28 18:41:33 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR70011%27 HTTP/1.1" 200 None
2026-03-28 18:41:33 [auto1.de] INFO: Scrape type for WR70011: 0
2026-03-28 18:41:33 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-28 18:41:33 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-28 18:41:33 [auto1.de] INFO: Scrape type for UP55636: 1
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_32577c73f2754e3c4480b8c687c545d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UZ60031> (referer: https://www.auto1.com/v1/car-details-view/UZ60031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:33 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-28 18:41:33 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-28 18:41:33 [auto1.de] INFO: Scrape type for ZT83144: 2
2026-03-28 18:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with identifier: ZT83144
2026-03-28 18:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with scrape type 2
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with scrape type 2
2026-03-28 18:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f, identifier: ZT83144
2026-03-28 18:41:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf3c10>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_9c27be70869858bc21996ad00bf30623.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_9c27be70869858bc21996ad00bf30623.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb2cd0>
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_dea1a6db716052582b32988c9167d77c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_dea1a6db716052582b32988c9167d77c.jpg saved to cache
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with identifier: GZ82101
2026-03-28 18:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with scrape type 1
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_a43f9a89b3d394b57b78138aa8dd2583.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_a43f9a89b3d394b57b78138aa8dd2583.jpg not downloaded yet
2026-03-28 18:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cc7ca0d-c119-5051-8b85-bdc54b534245 with identifier: WB83413
2026-03-28 18:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc7ca0d-c119-5051-8b85-bdc54b534245 with scrape type 1
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 1cc7ca0d-c119-5051-8b85-bdc54b534245
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_f65d2e2495c087335bc454fed38dcde4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_f65d2e2495c087335bc454fed38dcde4.jpg not downloaded yet
2026-03-28 18:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with identifier: ZT83144
2026-03-28 18:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with identifier: ZT83144
2026-03-28 18:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24fbc3ce-1fe2-5a34-b5da-34d30d4b349f with identifier: ZT83144 to the API
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:28:49Z',
 'fuel_type': 'diesel',
 'id': '24fbc3ce-1fe2-5a34-b5da-34d30d4b349f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT83144',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 204817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 250 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2012}
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT83144%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Saving data for ZT83144: {'auction_closing_time': 1774884529.0, 'created_time': 1774002253.259746, 'last_price_update_time': 1774723294.365597}
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT83144') HTTP/1.1" 204 0
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for UY91981: 1
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_c8cc3d36703a40ca6f134b5eb393445d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c8cc3d36703a40ca6f134b5eb393445d.jpg not downloaded yet
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_a3296ab5e73f172465bb8da02470fef6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_a3296ab5e73f172465bb8da02470fef6.jpg not downloaded yet
2026-03-28 18:41:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX47236> (referer: https://www.auto1.com/v1/car-details-view/XX47236/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for VR01975: 1
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_c9130ff35c70edf3f50ba0e0cae1e20d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c9130ff35c70edf3f50ba0e0cae1e20d.jpg not downloaded yet
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_a441d048a9d17a46330d92071fd1bf7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_a441d048a9d17a46330d92071fd1bf7f.jpg not downloaded yet
2026-03-28 18:41:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc9c450>
2026-03-28 18:41:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_824299475b200e9aa187ef41bdb5d46b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_824299475b200e9aa187ef41bdb5d46b.jpg saved to cache
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:41:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b11e4d0>
2026-03-28 18:41:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_32577c73f2754e3c4480b8c687c545d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_32577c73f2754e3c4480b8c687c545d4.jpg saved to cache
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0414232b-43c2-550a-9bd2-d4591d9f2121 with identifier: UZ60031
2026-03-28 18:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0414232b-43c2-550a-9bd2-d4591d9f2121 with scrape type 1
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 0414232b-43c2-550a-9bd2-d4591d9f2121
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_c17c2b6939df0bbb979aa7331510ea03.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_c17c2b6939df0bbb979aa7331510ea03.jpg not downloaded yet
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for HL66974: 1
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_c26f33be1239765df1ad5fcda049c557.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c26f33be1239765df1ad5fcda049c557.jpg not downloaded yet
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_b1b7df8ad79c3e98e82308d727508d94.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_b1b7df8ad79c3e98e82308d727508d94.jpg not downloaded yet
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_a5446da3d0e1be53ab9194d16427362e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_8182eb150c693cde8672781dd4d0da54.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_f65d2e2495c087335bc454fed38dcde4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_a43f9a89b3d394b57b78138aa8dd2583.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_ec282dc916577660ecd781a09da731d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_ec282dc916577660ecd781a09da731d4.jpg not downloaded yet
2026-03-28 18:41:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_ae9338ae1cb8c1090bf4be89fe8aba58.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for CJ73141: 1
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_0413994346de4b48d763cc28f6a579a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_0413994346de4b48d763cc28f6a579a3.jpg not downloaded yet
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_9a80d66ed705c3a3e19ecbe55833308f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_9a80d66ed705c3a3e19ecbe55833308f.jpg not downloaded yet
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_37d45076f11fa80309b6dea54189df64.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_1b826f634f9b9584a651ed32dc5d1a7e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_1b826f634f9b9584a651ed32dc5d1a7e.jpg not downloaded yet
2026-03-28 18:41:34 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [auto1.de] INFO: Scrape type for LT88740: 2
2026-03-28 18:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a68d32-d9c0-552d-acb4-159293946c40 with identifier: LT88740
2026-03-28 18:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a68d32-d9c0-552d-acb4-159293946c40 with scrape type 2
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a68d32-d9c0-552d-acb4-159293946c40 with scrape type 2
2026-03-28 18:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1a68d32-d9c0-552d-acb4-159293946c40, identifier: LT88740
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_141b9c014b7f507a055df298513db3e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_141b9c014b7f507a055df298513db3e6.jpg not downloaded yet
2026-03-28 18:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d464d16e-6736-5899-90fc-5887905f8eb0 with identifier: XX47236
2026-03-28 18:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d464d16e-6736-5899-90fc-5887905f8eb0 with scrape type 1
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d464d16e-6736-5899-90fc-5887905f8eb0
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_e6ae701d59d234e2601c36b458c23a42.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_e6ae701d59d234e2601c36b458c23a42.jpg not downloaded yet
2026-03-28 18:41:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_3359c4929b8f6769350b6e0d84c50d96.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1a68d32-d9c0-552d-acb4-159293946c40 with identifier: LT88740
2026-03-28 18:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1a68d32-d9c0-552d-acb4-159293946c40 with identifier: LT88740
2026-03-28 18:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1a68d32-d9c0-552d-acb4-159293946c40 with identifier: LT88740 to the API
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:10:39Z',
 'fuel_type': 'petrol',
 'id': 'd1a68d32-d9c0-552d-acb4-159293946c40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT88740',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 109218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-23',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2004}
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT88740%27 HTTP/1.1" 200 None
2026-03-28 18:41:35 [auto1.de] INFO: Saving data for LT88740: {'auction_closing_time': 1774883439.0, 'created_time': 1774118561.518442, 'last_price_update_time': 1774723295.30168}
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT88740') HTTP/1.1" 204 0
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_3c74f19dceaec624792cfd61fa4369ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_3c74f19dceaec624792cfd61fa4369ba.jpg not downloaded yet
2026-03-28 18:41:35 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-28 18:41:35 [auto1.de] INFO: Scrape type for FE36611: 1
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_c4434731ce03b0d1a0fb2e5231ea3353.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_c4434731ce03b0d1a0fb2e5231ea3353.jpg not downloaded yet
2026-03-28 18:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_a3296ab5e73f172465bb8da02470fef6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_578cd8c4789859e11dfc287e3e2c7667.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_7320f47201237aa48ef194fda283d068.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_736b24df723fe825e371f6cc8e33c9f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_8adc0f43fbca7e3bc887118bea1a0679.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_8adc0f43fbca7e3bc887118bea1a0679.jpg not downloaded yet
2026-03-28 18:41:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_c17c2b6939df0bbb979aa7331510ea03.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:35 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-28 18:41:35 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-28 18:41:35 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-28 18:41:35 [auto1.de] INFO: Scrape type for ST78057: 2
2026-03-28 18:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19a001bc-717d-55cf-9874-d0f17b93182a with identifier: ST78057
2026-03-28 18:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19a001bc-717d-55cf-9874-d0f17b93182a with scrape type 2
2026-03-28 18:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19a001bc-717d-55cf-9874-d0f17b93182a with scrape type 2
2026-03-28 18:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19a001bc-717d-55cf-9874-d0f17b93182a, identifier: ST78057
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_7195dd37645bf87f4554d357a116b971.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_7195dd37645bf87f4554d357a116b971.jpg not downloaded yet
2026-03-28 18:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19a001bc-717d-55cf-9874-d0f17b93182a with identifier: ST78057
2026-03-28 18:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19a001bc-717d-55cf-9874-d0f17b93182a with identifier: ST78057
2026-03-28 18:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19a001bc-717d-55cf-9874-d0f17b93182a with identifier: ST78057 to the API
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:45:57Z',
 'fuel_type': 'petrol',
 'id': '19a001bc-717d-55cf-9874-d0f17b93182a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST78057',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 94267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-10',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Cross up!',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2013}
2026-03-28 18:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78057%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [auto1.de] INFO: Saving data for ST78057: {'auction_closing_time': 1774885557.0, 'created_time': 1774032306.797111, 'last_price_update_time': 1774723296.003581}
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST78057') HTTP/1.1" 204 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_dac7e8ac74403f310627dd51678baf24.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_dac7e8ac74403f310627dd51678baf24.jpg not downloaded yet
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2176d0>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_a5446da3d0e1be53ab9194d16427362e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_a5446da3d0e1be53ab9194d16427362e.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb22650>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_8182eb150c693cde8672781dd4d0da54.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_8182eb150c693cde8672781dd4d0da54.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b193190>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_f65d2e2495c087335bc454fed38dcde4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_f65d2e2495c087335bc454fed38dcde4.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cc7ca0d-c119-5051-8b85-bdc54b534245
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb34810>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_a43f9a89b3d394b57b78138aa8dd2583.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_a43f9a89b3d394b57b78138aa8dd2583.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb21e90>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_ae9338ae1cb8c1090bf4be89fe8aba58.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_ae9338ae1cb8c1090bf4be89fe8aba58.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0400d0>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_37d45076f11fa80309b6dea54189df64.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_37d45076f11fa80309b6dea54189df64.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b192f50>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_3359c4929b8f6769350b6e0d84c50d96.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_3359c4929b8f6769350b6e0d84c50d96.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [auto1.de] INFO: Scrape type for PV80087: 1
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_2871b18150479377687542463ff18804.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_2871b18150479377687542463ff18804.jpg not downloaded yet
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_b1b7df8ad79c3e98e82308d727508d94.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_a441d048a9d17a46330d92071fd1bf7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_e6ae701d59d234e2601c36b458c23a42.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c9130ff35c70edf3f50ba0e0cae1e20d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UP55636/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RX22328> (referer: https://www.auto1.com/v1/car-details-view/RX22328/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_9a80d66ed705c3a3e19ecbe55833308f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:36 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [auto1.de] INFO: Scrape type for KY32435: 2
2026-03-28 18:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with identifier: KY32435
2026-03-28 18:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with scrape type 2
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with scrape type 2
2026-03-28 18:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81, identifier: KY32435
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_0867149924c96ba112dd0a7d91163309.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_0867149924c96ba112dd0a7d91163309.jpg not downloaded yet
2026-03-28 18:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda9750>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_a3296ab5e73f172465bb8da02470fef6.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_a3296ab5e73f172465bb8da02470fef6.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cc7ca0d-c119-5051-8b85-bdc54b534245
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b102250>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_578cd8c4789859e11dfc287e3e2c7667.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_578cd8c4789859e11dfc287e3e2c7667.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be70cd0>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_7320f47201237aa48ef194fda283d068.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_7320f47201237aa48ef194fda283d068.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02b6d0>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_736b24df723fe825e371f6cc8e33c9f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_736b24df723fe825e371f6cc8e33c9f9.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0196d0>
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_c17c2b6939df0bbb979aa7331510ea03.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_c17c2b6939df0bbb979aa7331510ea03.jpg saved to cache
2026-03-28 18:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0414232b-43c2-550a-9bd2-d4591d9f2121
2026-03-28 18:41:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_3c74f19dceaec624792cfd61fa4369ba.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with identifier: KY32435
2026-03-28 18:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with identifier: KY32435
2026-03-28 18:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4439f062-fb4c-5d27-83e8-3cc1acbd1b81 with identifier: KY32435 to the API
2026-03-28 18:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:04:44Z',
 'fuel_type': 'diesel',
 'id': '4439f062-fb4c-5d27-83e8-3cc1acbd1b81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY32435',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 132895,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2017}
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY32435%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Saving data for KY32435: {'auction_closing_time': 1774883084.0, 'created_time': 1773860234.130889, 'last_price_update_time': 1774723297.115838}
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY32435') HTTP/1.1" 204 0
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for PY07739: 2
2026-03-28 18:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b152afcd-f52e-56e0-ae21-32e659777614 with identifier: PY07739
2026-03-28 18:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b152afcd-f52e-56e0-ae21-32e659777614 with scrape type 2
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b152afcd-f52e-56e0-ae21-32e659777614 with scrape type 2
2026-03-28 18:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b152afcd-f52e-56e0-ae21-32e659777614, identifier: PY07739
2026-03-28 18:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_141b9c014b7f507a055df298513db3e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b152afcd-f52e-56e0-ae21-32e659777614 with identifier: PY07739
2026-03-28 18:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b152afcd-f52e-56e0-ae21-32e659777614 with identifier: PY07739
2026-03-28 18:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b152afcd-f52e-56e0-ae21-32e659777614 with identifier: PY07739 to the API
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:42:46Z',
 'fuel_type': 'petrol',
 'id': 'b152afcd-f52e-56e0-ae21-32e659777614',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY07739',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 22677,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI Mild-Hybrid advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2024}
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY07739%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Saving data for PY07739: {'auction_closing_time': 1774885366.0, 'created_time': 1774553016.669868, 'last_price_update_time': 1774723297.715591}
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY07739') HTTP/1.1" 204 0
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bebcd50>
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_b1b7df8ad79c3e98e82308d727508d94.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_b1b7df8ad79c3e98e82308d727508d94.jpg saved to cache
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cc7ca0d-c119-5051-8b85-bdc54b534245
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb54a10>
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_a441d048a9d17a46330d92071fd1bf7f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_a441d048a9d17a46330d92071fd1bf7f.jpg saved to cache
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cc7ca0d-c119-5051-8b85-bdc54b534245
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b015c10>
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_e6ae701d59d234e2601c36b458c23a42.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_e6ae701d59d234e2601c36b458c23a42.jpg saved to cache
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d464d16e-6736-5899-90fc-5887905f8eb0
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b009e90>
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_c9130ff35c70edf3f50ba0e0cae1e20d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c9130ff35c70edf3f50ba0e0cae1e20d.jpg saved to cache
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc
2026-03-28 18:41:37 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43b09e42-afec-5653-a101-b286949b5a95 with identifier: RX22328
2026-03-28 18:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b09e42-afec-5653-a101-b286949b5a95 with scrape type 1
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_bca50f98869e38f2fb4448e978797186.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_bca50f98869e38f2fb4448e978797186.jpg not downloaded yet
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc95490>
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_9a80d66ed705c3a3e19ecbe55833308f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_9a80d66ed705c3a3e19ecbe55833308f.jpg saved to cache
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cc7ca0d-c119-5051-8b85-bdc54b534245
2026-03-28 18:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_1b826f634f9b9584a651ed32dc5d1a7e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_8adc0f43fbca7e3bc887118bea1a0679.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-28 18:41:37 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-28 18:41:37 [auto1.de] INFO: Scrape type for DN86096: 1
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb3c750>
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_3c74f19dceaec624792cfd61fa4369ba.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_3c74f19dceaec624792cfd61fa4369ba.jpg saved to cache
2026-03-28 18:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0414232b-43c2-550a-9bd2-d4591d9f2121
2026-03-28 18:41:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_0413994346de4b48d763cc28f6a579a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_2871b18150479377687542463ff18804.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_dac7e8ac74403f310627dd51678baf24.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [auto1.de] INFO: Scrape type for AC34212: 1
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_8abd3b3a8a896b2cb1897e1e62d7d83c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_8abd3b3a8a896b2cb1897e1e62d7d83c.jpg not downloaded yet
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [auto1.de] INFO: Scrape type for RV77607: 2
2026-03-28 18:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63e300ed-3954-56d4-afe8-4b59858d928e with identifier: RV77607
2026-03-28 18:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63e300ed-3954-56d4-afe8-4b59858d928e with scrape type 2
2026-03-28 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63e300ed-3954-56d4-afe8-4b59858d928e with scrape type 2
2026-03-28 18:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63e300ed-3954-56d4-afe8-4b59858d928e, identifier: RV77607
2026-03-28 18:41:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb51fd0>
2026-03-28 18:41:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg25%252F11%252F2511f0f83719f739031d6267c63e9748%252Fpa%252FWB83413_141b9c014b7f507a055df298513db3e6.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_141b9c014b7f507a055df298513db3e6.jpg saved to cache
2026-03-28 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cc7ca0d-c119-5051-8b85-bdc54b534245
2026-03-28 18:41:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cc7ca0d-c119-5051-8b85-bdc54b534245, skipping ID generation
2026-03-28 18:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1cc7ca0d-c119-5051-8b85-bdc54b534245 with scrape type 1
2026-03-28 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cc7ca0d-c119-5051-8b85-bdc54b534245 sending to next pipeline
2026-03-28 18:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1cc7ca0d-c119-5051-8b85-bdc54b534245, identifier: WB83413
2026-03-28 18:41:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_7195dd37645bf87f4554d357a116b971.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63e300ed-3954-56d4-afe8-4b59858d928e with identifier: RV77607
2026-03-28 18:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63e300ed-3954-56d4-afe8-4b59858d928e with identifier: RV77607
2026-03-28 18:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63e300ed-3954-56d4-afe8-4b59858d928e with identifier: RV77607 to the API
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:47Z',
 'fuel_type': 'gas',
 'id': '63e300ed-3954-56d4-afe8-4b59858d928e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV77607',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 89413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 TGI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV77607%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [auto1.de] INFO: Saving data for RV77607: {'auction_closing_time': 1774884107.0, 'created_time': 1774521622.033738, 'last_price_update_time': 1774723298.648917}
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV77607') HTTP/1.1" 204 0
2026-03-28 18:41:38 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [auto1.de] INFO: Scrape type for EW67018: 1
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_2b8fb1376bc4831a87bb0e7c3807d76a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_2b8fb1376bc4831a87bb0e7c3807d76a.jpg not downloaded yet
2026-03-28 18:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1cc7ca0d-c119-5051-8b85-bdc54b534245 with identifier: WB83413
2026-03-28 18:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1cc7ca0d-c119-5051-8b85-bdc54b534245 with identifier: WB83413
2026-03-28 18:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1cc7ca0d-c119-5051-8b85-bdc54b534245 with identifier: WB83413 to the API
2026-03-28 18:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_141b9c014b7f507a055df298513db3e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 182,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:28Z',
 'fuel_type': 'diesel',
 'id': '1cc7ca0d-c119-5051-8b85-bdc54b534245',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WB83413',
 'listing': 'auction',
 'location': 'DE, Blankenfelde-Mahlow',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 379178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_f65d2e2495c087335bc454fed38dcde4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_a3296ab5e73f172465bb8da02470fef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_a441d048a9d17a46330d92071fd1bf7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_b1b7df8ad79c3e98e82308d727508d94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_9a80d66ed705c3a3e19ecbe55833308f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cc7ca0d-c119-5051-8b85-bdc54b534245/1cc7ca0d-c119-5051-8b85-bdc54b534245_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img25/11/2511f0f83719f739031d6267c63e9748/pa/WB83413_141b9c014b7f507a055df298513db3e6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2008}
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB83413%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Saving data for WB83413: {'created_time': 1774723299.141938, 'last_price_update_time': 1774723299.14195, 'auction_closing_time': 1774885528.0}
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WB83413') HTTP/1.1" 204 0
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_c4434731ce03b0d1a0fb2e5231ea3353.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_ec282dc916577660ecd781a09da731d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for UP26126: 2
2026-03-28 18:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with identifier: UP26126
2026-03-28 18:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with scrape type 2
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with scrape type 2
2026-03-28 18:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 356511fb-5dbd-5350-b3c3-cf15a8c143b1, identifier: UP26126
2026-03-28 18:41:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10f190>
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_1b826f634f9b9584a651ed32dc5d1a7e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_1b826f634f9b9584a651ed32dc5d1a7e.jpg saved to cache
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0414232b-43c2-550a-9bd2-d4591d9f2121
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b160b10>
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_8adc0f43fbca7e3bc887118bea1a0679.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_8adc0f43fbca7e3bc887118bea1a0679.jpg saved to cache
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0414232b-43c2-550a-9bd2-d4591d9f2121
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c26f33be1239765df1ad5fcda049c557.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with identifier: UP26126
2026-03-28 18:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with identifier: UP26126
2026-03-28 18:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 356511fb-5dbd-5350-b3c3-cf15a8c143b1 with identifier: UP26126 to the API
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:14Z',
 'fuel_type': 'petrol',
 'id': '356511fb-5dbd-5350-b3c3-cf15a8c143b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP26126',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 178333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP26126%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Saving data for UP26126: {'auction_closing_time': 1774884974.0, 'created_time': 1774349000.309853, 'last_price_update_time': 1774723299.73515}
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP26126') HTTP/1.1" 204 0
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for AL30364: 1
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_049fb4d93f941829af082ee4f87fb3c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_049fb4d93f941829af082ee4f87fb3c9.jpg not downloaded yet
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV80087/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE36611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_0867149924c96ba112dd0a7d91163309.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c8cc3d36703a40ca6f134b5eb393445d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for TV59519: 1
2026-03-28 18:41:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR01975/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b18a0d0>
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_0413994346de4b48d763cc28f6a579a3.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_0413994346de4b48d763cc28f6a579a3.jpg saved to cache
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b06ef50>
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_2871b18150479377687542463ff18804.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_2871b18150479377687542463ff18804.jpg saved to cache
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d464d16e-6736-5899-90fc-5887905f8eb0
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b014990>
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_dac7e8ac74403f310627dd51678baf24.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_dac7e8ac74403f310627dd51678baf24.jpg saved to cache
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0414232b-43c2-550a-9bd2-d4591d9f2121
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb615d0>
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_7195dd37645bf87f4554d357a116b971.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_7195dd37645bf87f4554d357a116b971.jpg saved to cache
2026-03-28 18:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d464d16e-6736-5899-90fc-5887905f8eb0
2026-03-28 18:41:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_bca50f98869e38f2fb4448e978797186.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:39 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-28 18:41:39 [auto1.de] INFO: Scrape type for FW19107: 1
2026-03-28 18:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_de5934168f8d72696dd1de6a010dfec8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_de5934168f8d72696dd1de6a010dfec8.jpg not downloaded yet
2026-03-28 18:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-28 18:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CJ73141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a4590>
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_c4434731ce03b0d1a0fb2e5231ea3353.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_c4434731ce03b0d1a0fb2e5231ea3353.jpg saved to cache
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d464d16e-6736-5899-90fc-5887905f8eb0
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b297590>
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc7%252F50c7de89780843d5c42c31d31e91dd50%252Fpa%252FUZ60031_ec282dc916577660ecd781a09da731d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_ec282dc916577660ecd781a09da731d4.jpg saved to cache
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0414232b-43c2-550a-9bd2-d4591d9f2121
2026-03-28 18:41:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0414232b-43c2-550a-9bd2-d4591d9f2121, skipping ID generation
2026-03-28 18:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0414232b-43c2-550a-9bd2-d4591d9f2121 with scrape type 1
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0414232b-43c2-550a-9bd2-d4591d9f2121 sending to next pipeline
2026-03-28 18:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0414232b-43c2-550a-9bd2-d4591d9f2121, identifier: UZ60031
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b19f210>
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_c26f33be1239765df1ad5fcda049c557.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c26f33be1239765df1ad5fcda049c557.jpg saved to cache
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-28 18:41:40 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Scrape type for SJ02125: 2
2026-03-28 18:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fec6a21-0184-5a46-b8ef-2e2020d2abea with identifier: SJ02125
2026-03-28 18:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fec6a21-0184-5a46-b8ef-2e2020d2abea with scrape type 2
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fec6a21-0184-5a46-b8ef-2e2020d2abea with scrape type 2
2026-03-28 18:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fec6a21-0184-5a46-b8ef-2e2020d2abea, identifier: SJ02125
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_ede58bf3d15373fb70022f56885f5690.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_ede58bf3d15373fb70022f56885f5690.jpg not downloaded yet
2026-03-28 18:41:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0414232b-43c2-550a-9bd2-d4591d9f2121 with identifier: UZ60031
2026-03-28 18:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0414232b-43c2-550a-9bd2-d4591d9f2121 with identifier: UZ60031
2026-03-28 18:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0414232b-43c2-550a-9bd2-d4591d9f2121 with identifier: UZ60031 to the API
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_ec282dc916577660ecd781a09da731d4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:04:36Z',
 'fuel_type': 'petrol',
 'id': '0414232b-43c2-550a-9bd2-d4591d9f2121',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ60031',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 142815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_c17c2b6939df0bbb979aa7331510ea03.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_ec282dc916577660ecd781a09da731d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_1b826f634f9b9584a651ed32dc5d1a7e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_3c74f19dceaec624792cfd61fa4369ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_8adc0f43fbca7e3bc887118bea1a0679.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0414232b-43c2-550a-9bd2-d4591d9f2121/0414232b-43c2-550a-9bd2-d4591d9f2121_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c7/50c7de89780843d5c42c31d31e91dd50/pa/UZ60031_dac7e8ac74403f310627dd51678baf24.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-10-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2009}
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ60031%27 HTTP/1.1" 200 None
2026-03-28 18:41:40 [auto1.de] INFO: Saving data for UZ60031: {'created_time': 1774723300.786294, 'last_price_update_time': 1774723300.786306, 'auction_closing_time': 1774883076.0}
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ60031') HTTP/1.1" 204 0
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcf0150>
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252Fcf%252Fe4cfde629e71698985de8e47a45cb823%252Fpa%252FXX47236_0867149924c96ba112dd0a7d91163309.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_0867149924c96ba112dd0a7d91163309.jpg saved to cache
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d464d16e-6736-5899-90fc-5887905f8eb0
2026-03-28 18:41:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d464d16e-6736-5899-90fc-5887905f8eb0, skipping ID generation
2026-03-28 18:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d464d16e-6736-5899-90fc-5887905f8eb0 with scrape type 1
2026-03-28 18:41:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d464d16e-6736-5899-90fc-5887905f8eb0 sending to next pipeline
2026-03-28 18:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d464d16e-6736-5899-90fc-5887905f8eb0, identifier: XX47236
2026-03-28 18:41:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b22d990>
2026-03-28 18:41:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg92%252Fc9%252F92c950a78b3af0a42c03cdbc9306f316%252Fpa%252FGZ82101_c8cc3d36703a40ca6f134b5eb393445d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c8cc3d36703a40ca6f134b5eb393445d.jpg saved to cache
2026-03-28 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc
2026-03-28 18:41:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc, skipping ID generation
2026-03-28 18:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with scrape type 1
2026-03-28 18:41:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc sending to next pipeline
2026-03-28 18:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc, identifier: GZ82101
2026-03-28 18:41:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_d8fdae90fd77a936f06d29eb0de65f2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fec6a21-0184-5a46-b8ef-2e2020d2abea with identifier: SJ02125
2026-03-28 18:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fec6a21-0184-5a46-b8ef-2e2020d2abea with identifier: SJ02125
2026-03-28 18:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fec6a21-0184-5a46-b8ef-2e2020d2abea with identifier: SJ02125 to the API
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:01:34Z',
 'fuel_type': 'diesel',
 'id': '7fec6a21-0184-5a46-b8ef-2e2020d2abea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ02125',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Logan MCV',
 'odometer': 233770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-31',
 'seller_name': None,
 'title': 'Dacia Logan MCV 1.5 dCi Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2015}
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ02125%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Saving data for SJ02125: {'auction_closing_time': 1774882894.0, 'created_time': 1774349151.99935, 'last_price_update_time': 1774723301.558588}
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ02125') HTTP/1.1" 204 0
2026-03-28 18:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d464d16e-6736-5899-90fc-5887905f8eb0 with identifier: XX47236
2026-03-28 18:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d464d16e-6736-5899-90fc-5887905f8eb0 with identifier: XX47236
2026-03-28 18:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d464d16e-6736-5899-90fc-5887905f8eb0 with identifier: XX47236 to the API
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_0867149924c96ba112dd0a7d91163309.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:15:33Z',
 'fuel_type': 'petrol',
 'id': 'd464d16e-6736-5899-90fc-5887905f8eb0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX47236',
 'listing': 'auction',
 'location': 'DE, Bayreuth',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 332109,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_e6ae701d59d234e2601c36b458c23a42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_c4434731ce03b0d1a0fb2e5231ea3353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90342,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_7195dd37645bf87f4554d357a116b971.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_2871b18150479377687542463ff18804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d464d16e-6736-5899-90fc-5887905f8eb0/d464d16e-6736-5899-90fc-5887905f8eb0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/cf/e4cfde629e71698985de8e47a45cb823/pa/XX47236_0867149924c96ba112dd0a7d91163309.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-02-23',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX47236%27 HTTP/1.1" 200 None
2026-03-28 18:41:41 [auto1.de] INFO: Saving data for XX47236: {'created_time': 1774723301.994677, 'last_price_update_time': 1774723301.994691, 'auction_closing_time': 1774883733.0}
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX47236') HTTP/1.1" 204 0
2026-03-28 18:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with identifier: GZ82101
2026-03-28 18:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with identifier: GZ82101
2026-03-28 18:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc with identifier: GZ82101 to the API
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c8cc3d36703a40ca6f134b5eb393445d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:52:18Z',
 'fuel_type': 'petrol',
 'id': '9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ82101',
 'listing': 'auction',
 'location': 'DE, Braunschweig',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 180325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95701,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_a43f9a89b3d394b57b78138aa8dd2583.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83025,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c8cc3d36703a40ca6f134b5eb393445d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c9130ff35c70edf3f50ba0e0cae1e20d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_c26f33be1239765df1ad5fcda049c557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc/9e438135-4edb-5dd3-ad0c-3ad7cb1f25fc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img92/c9/92c950a78b3af0a42c03cdbc9306f316/pa/GZ82101_0413994346de4b48d763cc28f6a579a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-05-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2009}
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ82101%27 HTTP/1.1" 200 None
2026-03-28 18:41:42 [auto1.de] INFO: Saving data for GZ82101: {'created_time': 1774723302.378536, 'last_price_update_time': 1774723302.378551, 'auction_closing_time': 1774885938.0}
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ82101') HTTP/1.1" 204 0
2026-03-28 18:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_619172fb0f46aca094ee7997670b4f7a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:42 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-28 18:41:42 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-28 18:41:42 [auto1.de] INFO: Scrape type for VL24807: 1
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_74cab51f49b44e71682fb31b334b6709.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_74cab51f49b44e71682fb31b334b6709.jpg not downloaded yet
2026-03-28 18:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HL66974/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN86096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b022250>
2026-03-28 18:41:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_bca50f98869e38f2fb4448e978797186.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_bca50f98869e38f2fb4448e978797186.jpg saved to cache
2026-03-28 18:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:42 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-28 18:41:42 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-28 18:41:42 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-28 18:41:42 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-28 18:41:42 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-28 18:41:42 [auto1.de] INFO: Scrape type for NF97550: 2
2026-03-28 18:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with identifier: NF97550
2026-03-28 18:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with scrape type 2
2026-03-28 18:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with scrape type 2
2026-03-28 18:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f97e4a1-8516-5cf7-9261-ea408182e0f5, identifier: NF97550
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_192418e3a3c4ce27725f1301c8edc1e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_192418e3a3c4ce27725f1301c8edc1e2.jpg not downloaded yet
2026-03-28 18:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with identifier: NF97550
2026-03-28 18:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with identifier: NF97550
2026-03-28 18:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f97e4a1-8516-5cf7-9261-ea408182e0f5 with identifier: NF97550 to the API
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:09:25Z',
 'fuel_type': 'diesel',
 'id': '7f97e4a1-8516-5cf7-9261-ea408182e0f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF97550',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 178730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-26',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF97550%27 HTTP/1.1" 200 None
2026-03-28 18:41:42 [auto1.de] INFO: Saving data for NF97550: {'auction_closing_time': 1774883365.0, 'created_time': 1773467300.581084, 'last_price_update_time': 1774723302.995419}
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF97550') HTTP/1.1" 204 0
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17c150>
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_d8fdae90fd77a936f06d29eb0de65f2f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_d8fdae90fd77a936f06d29eb0de65f2f.jpg saved to cache
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_de5934168f8d72696dd1de6a010dfec8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for ZA82087: 1
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_c51fb98cc15299ecc2f0ee98bae9dfd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_c51fb98cc15299ecc2f0ee98bae9dfd6.jpg not downloaded yet
2026-03-28 18:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_ede58bf3d15373fb70022f56885f5690.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb55a10>
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_619172fb0f46aca094ee7997670b4f7a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_619172fb0f46aca094ee7997670b4f7a.jpg saved to cache
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:43 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 6008 | hits on page: 40
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for PR51827: 1
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_6ffb8d674c82de85dfce1f2bd4bf0109.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_6ffb8d674c82de85dfce1f2bd4bf0109.jpg not downloaded yet
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for XT67395: 2
2026-03-28 18:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc5294da-b9cb-59c1-919c-9204164e6ed4 with identifier: XT67395
2026-03-28 18:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc5294da-b9cb-59c1-919c-9204164e6ed4 with scrape type 2
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc5294da-b9cb-59c1-919c-9204164e6ed4 with scrape type 2
2026-03-28 18:41:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc5294da-b9cb-59c1-919c-9204164e6ed4, identifier: XT67395
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for KU26816: 1
2026-03-28 18:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc5294da-b9cb-59c1-919c-9204164e6ed4 with identifier: XT67395
2026-03-28 18:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc5294da-b9cb-59c1-919c-9204164e6ed4 with identifier: XT67395
2026-03-28 18:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc5294da-b9cb-59c1-919c-9204164e6ed4 with identifier: XT67395 to the API
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:58:23Z',
 'fuel_type': 'petrol',
 'id': 'fc5294da-b9cb-59c1-919c-9204164e6ed4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT67395',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 53227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-30',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2022}
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67395%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Saving data for XT67395: {'auction_closing_time': 1774886303.0, 'created_time': 1774034140.079845, 'last_price_update_time': 1774723303.665351}
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT67395') HTTP/1.1" 204 0
2026-03-28 18:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_b2aaf6b79421fbc58cb955bb94af17e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for XT85364: 1
2026-03-28 18:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_192418e3a3c4ce27725f1301c8edc1e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for CM42106: 1
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b58bb8250>
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_de5934168f8d72696dd1de6a010dfec8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_de5934168f8d72696dd1de6a010dfec8.jpg saved to cache
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b288f10>
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_ede58bf3d15373fb70022f56885f5690.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_ede58bf3d15373fb70022f56885f5690.jpg saved to cache
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_7c5c2cbe10bfa4805c7003d983ed01de.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for KJ39198: 1
2026-03-28 18:41:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AL30364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-28 18:41:43 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-28 18:41:43 [auto1.de] INFO: Scrape type for UR14680: 2
2026-03-28 18:41:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 161c396b-4960-5d3c-b8b8-9c51300527f2 with identifier: UR14680
2026-03-28 18:41:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 161c396b-4960-5d3c-b8b8-9c51300527f2 with scrape type 2
2026-03-28 18:41:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 161c396b-4960-5d3c-b8b8-9c51300527f2 with scrape type 2
2026-03-28 18:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 161c396b-4960-5d3c-b8b8-9c51300527f2, identifier: UR14680
2026-03-28 18:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 161c396b-4960-5d3c-b8b8-9c51300527f2 with identifier: UR14680
2026-03-28 18:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 161c396b-4960-5d3c-b8b8-9c51300527f2 with identifier: UR14680
2026-03-28 18:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 161c396b-4960-5d3c-b8b8-9c51300527f2 with identifier: UR14680 to the API
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:53:49Z',
 'fuel_type': 'petrol',
 'id': '161c396b-4960-5d3c-b8b8-9c51300527f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR14680',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 63199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 X-TRA',
 'transmission': 'manual',
 'trim': 'X-TRA',
 'year': 2017}
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14680%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Saving data for UR14680: {'auction_closing_time': 1774886029.0, 'created_time': 1774033898.900501, 'last_price_update_time': 1774723304.433293}
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR14680') HTTP/1.1" 204 0
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for EX55373: 1
2026-03-28 18:41:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc013d0>
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_b2aaf6b79421fbc58cb955bb94af17e1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_b2aaf6b79421fbc58cb955bb94af17e1.jpg saved to cache
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for GZ33681: 1
2026-03-28 18:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_6ffb8d674c82de85dfce1f2bd4bf0109.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for BN44220: 1
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-28 18:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UP55636> (referer: https://www.auto1.com/v1/car-details-view/UP55636/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE36611> (referer: https://www.auto1.com/v1/car-details-view/FE36611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW67018/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY91981/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ff5110>
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_192418e3a3c4ce27725f1301c8edc1e2.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_192418e3a3c4ce27725f1301c8edc1e2.jpg saved to cache
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcfc50>
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_7c5c2cbe10bfa4805c7003d983ed01de.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_7c5c2cbe10bfa4805c7003d983ed01de.jpg saved to cache
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for KT60539: 1
2026-03-28 18:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for JM65569: 1
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2af090>
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_6ffb8d674c82de85dfce1f2bd4bf0109.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_6ffb8d674c82de85dfce1f2bd4bf0109.jpg saved to cache
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96a9fc37-8973-53f1-b9d5-0689115e690a with identifier: UP55636
2026-03-28 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a9fc37-8973-53f1-b9d5-0689115e690a with scrape type 1
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_54d75b3dcba4b55f2e35faf7682d8b4a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_54d75b3dcba4b55f2e35faf7682d8b4a.jpg not downloaded yet
2026-03-28 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with identifier: FE36611
2026-03-28 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with scrape type 1
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_41305302cd622f277b4dfca95654a9a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_41305302cd622f277b4dfca95654a9a7.jpg not downloaded yet
2026-03-28 18:41:44 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-28 18:41:44 [auto1.de] INFO: Scrape type for LX23482: 2
2026-03-28 18:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da906c4b-3b74-5349-83dd-90bdb06913c8 with identifier: LX23482
2026-03-28 18:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da906c4b-3b74-5349-83dd-90bdb06913c8 with scrape type 2
2026-03-28 18:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da906c4b-3b74-5349-83dd-90bdb06913c8 with scrape type 2
2026-03-28 18:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da906c4b-3b74-5349-83dd-90bdb06913c8, identifier: LX23482
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_d687b34c6fafdf067a785fe785c6fd54.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_d687b34c6fafdf067a785fe785c6fd54.jpg not downloaded yet
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_59d74eaca87be157617445e1c02bae4e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_59d74eaca87be157617445e1c02bae4e.jpg not downloaded yet
2026-03-28 18:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da906c4b-3b74-5349-83dd-90bdb06913c8 with identifier: LX23482
2026-03-28 18:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da906c4b-3b74-5349-83dd-90bdb06913c8 with identifier: LX23482
2026-03-28 18:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da906c4b-3b74-5349-83dd-90bdb06913c8 with identifier: LX23482 to the API
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:06:38Z',
 'fuel_type': 'diesel',
 'id': 'da906c4b-3b74-5349-83dd-90bdb06913c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX23482',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 191787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-02',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX23482%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Saving data for LX23482: {'auction_closing_time': 1774883198.0, 'created_time': 1774032325.481548, 'last_price_update_time': 1774723305.482202}
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX23482') HTTP/1.1" 204 0
2026-03-28 18:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW19107/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for KC29293: 1
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_fa27f8f74fe1070cbab7cd282678b2d4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_fa27f8f74fe1070cbab7cd282678b2d4.jpg not downloaded yet
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_924b56e2e0c955a1a8ce72fc375d31ea.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_924b56e2e0c955a1a8ce72fc375d31ea.jpg not downloaded yet
2026-03-28 18:41:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV80087> (referer: https://www.auto1.com/v1/car-details-view/PV80087/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for HM10485: 1
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_a873dac239fc6d14a1143dd7c7d0a06e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_a873dac239fc6d14a1143dd7c7d0a06e.jpg not downloaded yet
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_f39528d0845f6108fab1524a101a644b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_f39528d0845f6108fab1524a101a644b.jpg not downloaded yet
2026-03-28 18:41:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for GZ74020: 1
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_e4a63d2e2767cf7e5545d7d30ada8981.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_e4a63d2e2767cf7e5545d7d30ada8981.jpg not downloaded yet
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_a235de5a1dddcc8df89878b7c7d8a7db.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_a235de5a1dddcc8df89878b7c7d8a7db.jpg not downloaded yet
2026-03-28 18:41:45 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [auto1.de] INFO: Scrape type for HZ02763: 2
2026-03-28 18:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb38d6d-6628-5fba-8862-5115ad13eca4 with identifier: HZ02763
2026-03-28 18:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb38d6d-6628-5fba-8862-5115ad13eca4 with scrape type 2
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfb38d6d-6628-5fba-8862-5115ad13eca4 with scrape type 2
2026-03-28 18:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfb38d6d-6628-5fba-8862-5115ad13eca4, identifier: HZ02763
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_3d9ec0aaa47e0ed43da7871862d0ab0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_3d9ec0aaa47e0ed43da7871862d0ab0b.jpg not downloaded yet
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_3cab3d18e7e99a76a54be2fea8987e88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_3cab3d18e7e99a76a54be2fea8987e88.jpg not downloaded yet
2026-03-28 18:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfb38d6d-6628-5fba-8862-5115ad13eca4 with identifier: HZ02763
2026-03-28 18:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfb38d6d-6628-5fba-8862-5115ad13eca4 with identifier: HZ02763
2026-03-28 18:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfb38d6d-6628-5fba-8862-5115ad13eca4 with identifier: HZ02763 to the API
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:59:24Z',
 'fuel_type': 'petrol',
 'id': 'dfb38d6d-6628-5fba-8862-5115ad13eca4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ02763',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 196230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-02',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ02763%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [auto1.de] INFO: Saving data for HZ02763: {'auction_closing_time': 1774886364.0, 'created_time': 1774349197.053292, 'last_price_update_time': 1774723306.247921}
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ02763') HTTP/1.1" 204 0
2026-03-28 18:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff407923-78b1-5591-abdd-25c1aa59f1f4 with identifier: PV80087
2026-03-28 18:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff407923-78b1-5591-abdd-25c1aa59f1f4 with scrape type 1
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff407923-78b1-5591-abdd-25c1aa59f1f4
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_d5bebe2ded6454364834c391ade657a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_d5bebe2ded6454364834c391ade657a2.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_42e0b6629aceff641d299c49bdd3ae70.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_42e0b6629aceff641d299c49bdd3ae70.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_551a6d7c3e503b79bc7431e1ccde6de8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_551a6d7c3e503b79bc7431e1ccde6de8.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_1353935fb6437a86bab05eae1aace0e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_1353935fb6437a86bab05eae1aace0e2.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_cd8324cf7c8d191264effd5ad2d42437.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_cd8324cf7c8d191264effd5ad2d42437.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_3f4ba70e3771dad4842c600955f1abf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_3f4ba70e3771dad4842c600955f1abf4.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_40fa4d31d493b9c312a1b18bb8f7cd1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_40fa4d31d493b9c312a1b18bb8f7cd1d.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_03a333d8c0876270768280f7fafd03a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_03a333d8c0876270768280f7fafd03a1.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_a411b5748c4750e0e115ae03f2f509ba.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_a411b5748c4750e0e115ae03f2f509ba.jpg already downloaded
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F85%252Ff3858a23555bac54452194aac5ecf03a%252Fpa%252FPV80087_a1761668fdb16aac40e65b632833709b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_a1761668fdb16aac40e65b632833709b.jpg already downloaded
2026-03-28 18:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff407923-78b1-5591-abdd-25c1aa59f1f4, identifier: PV80087
2026-03-28 18:41:46 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [auto1.de] INFO: Scrape type for KZ16493: 1
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_5b4bb31c9d8259be37e81b4f71848804.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_5b4bb31c9d8259be37e81b4f71848804.jpg not downloaded yet
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_5dfe508d0139dcc56f828faf4493a82f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_5dfe508d0139dcc56f828faf4493a82f.jpg not downloaded yet
2026-03-28 18:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff407923-78b1-5591-abdd-25c1aa59f1f4 with identifier: PV80087
2026-03-28 18:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff407923-78b1-5591-abdd-25c1aa59f1f4 with identifier: PV80087
2026-03-28 18:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff407923-78b1-5591-abdd-25c1aa59f1f4 with identifier: PV80087 to the API
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PV80087>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:08Z',
 'fuel_type': 'petrol',
 'id': 'ff407923-78b1-5591-abdd-25c1aa59f1f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV80087',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 106065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_d5bebe2ded6454364834c391ade657a2.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_42e0b6629aceff641d299c49bdd3ae70.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_551a6d7c3e503b79bc7431e1ccde6de8.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_1353935fb6437a86bab05eae1aace0e2.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_cd8324cf7c8d191264effd5ad2d42437.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_3f4ba70e3771dad4842c600955f1abf4.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_40fa4d31d493b9c312a1b18bb8f7cd1d.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_03a333d8c0876270768280f7fafd03a1.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_a411b5748c4750e0e115ae03f2f509ba.jpg',
                'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_a1761668fdb16aac40e65b632833709b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_d5bebe2ded6454364834c391ade657a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_42e0b6629aceff641d299c49bdd3ae70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_551a6d7c3e503b79bc7431e1ccde6de8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_1353935fb6437a86bab05eae1aace0e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_cd8324cf7c8d191264effd5ad2d42437.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_3f4ba70e3771dad4842c600955f1abf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_40fa4d31d493b9c312a1b18bb8f7cd1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_03a333d8c0876270768280f7fafd03a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_a411b5748c4750e0e115ae03f2f509ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff407923-78b1-5591-abdd-25c1aa59f1f4/ff407923-78b1-5591-abdd-25c1aa59f1f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/85/f3858a23555bac54452194aac5ecf03a/pa/PV80087_a1761668fdb16aac40e65b632833709b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Excellence Start/Stop',
 'transmission': 'manual',
 'trim': 'Excellence Start/Stop',
 'year': 2017}
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV80087%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [auto1.de] INFO: Saving data for PV80087: {'created_time': 1774723306.907158, 'last_price_update_time': 1774723306.907171, 'auction_closing_time': 1774883768.0}
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV80087') HTTP/1.1" 204 0
2026-03-28 18:41:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_59d74eaca87be157617445e1c02bae4e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:46 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-28 18:41:46 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-28 18:41:46 [auto1.de] INFO: Scrape type for DF05561: 2
2026-03-28 18:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 411fe958-50ae-53c8-9bcf-3bc8bf92affa with identifier: DF05561
2026-03-28 18:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 411fe958-50ae-53c8-9bcf-3bc8bf92affa with scrape type 2
2026-03-28 18:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 411fe958-50ae-53c8-9bcf-3bc8bf92affa with scrape type 2
2026-03-28 18:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 411fe958-50ae-53c8-9bcf-3bc8bf92affa, identifier: DF05561
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_a94cc80c5576b76bc1cd84ddf14ffa8f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_a94cc80c5576b76bc1cd84ddf14ffa8f.jpg not downloaded yet
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_1ec901e10ad964df66772edd1cd880e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_1ec901e10ad964df66772edd1cd880e3.jpg not downloaded yet
2026-03-28 18:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 411fe958-50ae-53c8-9bcf-3bc8bf92affa with identifier: DF05561
2026-03-28 18:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 411fe958-50ae-53c8-9bcf-3bc8bf92affa with identifier: DF05561
2026-03-28 18:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 411fe958-50ae-53c8-9bcf-3bc8bf92affa with identifier: DF05561 to the API
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:58Z',
 'fuel_type': 'diesel',
 'id': '411fe958-50ae-53c8-9bcf-3bc8bf92affa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF05561',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 124221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Fiat 500X 2.0 Multijet Cross Plus',
 'transmission': 'manual',
 'trim': 'Cross Plus',
 'year': 2015}
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF05561%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Saving data for DF05561: {'auction_closing_time': 1774885138.0, 'created_time': 1774033862.356982, 'last_price_update_time': 1774723307.382968}
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF05561') HTTP/1.1" 204 0
2026-03-28 18:41:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC34212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for GK39429: 1
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_e6cc0478738fc30f102870d431385664.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_e6cc0478738fc30f102870d431385664.jpg not downloaded yet
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_95fbd48daaa6b66726e0e157381f6103.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_95fbd48daaa6b66726e0e157381f6103.jpg not downloaded yet
2026-03-28 18:41:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_2b8fb1376bc4831a87bb0e7c3807d76a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_049fb4d93f941829af082ee4f87fb3c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_3cab3d18e7e99a76a54be2fea8987e88.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-28 18:41:47 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [auto1.de] INFO: Scrape type for MV07839: 2
2026-03-28 18:41:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ca3482f-5fdd-559a-8364-77b4a0037042 with identifier: MV07839
2026-03-28 18:41:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ca3482f-5fdd-559a-8364-77b4a0037042 with scrape type 2
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ca3482f-5fdd-559a-8364-77b4a0037042 with scrape type 2
2026-03-28 18:41:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ca3482f-5fdd-559a-8364-77b4a0037042, identifier: MV07839
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_9a0e10b9549d0c5e39a174d371a1369e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_9a0e10b9549d0c5e39a174d371a1369e.jpg not downloaded yet
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_26b6cd9cc28a2d52391e5a20df6ff63e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_26b6cd9cc28a2d52391e5a20df6ff63e.jpg not downloaded yet
2026-03-28 18:41:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b25f050>
2026-03-28 18:41:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_59d74eaca87be157617445e1c02bae4e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_59d74eaca87be157617445e1c02bae4e.jpg saved to cache
2026-03-28 18:41:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:41:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ca3482f-5fdd-559a-8364-77b4a0037042 with identifier: MV07839
2026-03-28 18:41:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ca3482f-5fdd-559a-8364-77b4a0037042 with identifier: MV07839
2026-03-28 18:41:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ca3482f-5fdd-559a-8364-77b4a0037042 with identifier: MV07839 to the API
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:13:28Z',
 'fuel_type': 'diesel',
 'id': '6ca3482f-5fdd-559a-8364-77b4a0037042',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV07839',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 173220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-26',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV07839%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Saving data for MV07839: {'auction_closing_time': 1774883608.0, 'created_time': 1773427143.133777, 'last_price_update_time': 1774723308.108928}
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV07839') HTTP/1.1" 204 0
2026-03-28 18:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU26816/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for AW19440: 1
2026-03-28 18:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_8abd3b3a8a896b2cb1897e1e62d7d83c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ33681/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_a94cc80c5576b76bc1cd84ddf14ffa8f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for DG41556: 1
2026-03-28 18:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN44220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CJ73141> (referer: https://www.auto1.com/v1/car-details-view/CJ73141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR01975> (referer: https://www.auto1.com/v1/car-details-view/VR01975/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb645d0>
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_2b8fb1376bc4831a87bb0e7c3807d76a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_2b8fb1376bc4831a87bb0e7c3807d76a.jpg saved to cache
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b011490>
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_049fb4d93f941829af082ee4f87fb3c9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_049fb4d93f941829af082ee4f87fb3c9.jpg saved to cache
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16b8d0>
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_3cab3d18e7e99a76a54be2fea8987e88.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_3cab3d18e7e99a76a54be2fea8987e88.jpg saved to cache
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for HU15676: 1
2026-03-28 18:41:48 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [auto1.de] INFO: Scrape type for SV56483: 2
2026-03-28 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 570a6cf2-3d36-548d-a588-b304d6f8cec9 with identifier: SV56483
2026-03-28 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 570a6cf2-3d36-548d-a588-b304d6f8cec9 with scrape type 2
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 570a6cf2-3d36-548d-a588-b304d6f8cec9 with scrape type 2
2026-03-28 18:41:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 570a6cf2-3d36-548d-a588-b304d6f8cec9, identifier: SV56483
2026-03-28 18:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KJ39198/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b021c90>
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_8abd3b3a8a896b2cb1897e1e62d7d83c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_8abd3b3a8a896b2cb1897e1e62d7d83c.jpg saved to cache
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b25c7d0>
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_a94cc80c5576b76bc1cd84ddf14ffa8f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_a94cc80c5576b76bc1cd84ddf14ffa8f.jpg saved to cache
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d8948d1-6f87-5de2-90fe-acc74013515e with identifier: CJ73141
2026-03-28 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8948d1-6f87-5de2-90fe-acc74013515e with scrape type 1
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_cc6b48634817c517c364fe5644141c36.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc6b48634817c517c364fe5644141c36.jpg not downloaded yet
2026-03-28 18:41:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 665e0565-4699-51e9-906a-e5685aa77c62 with identifier: VR01975
2026-03-28 18:41:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 665e0565-4699-51e9-906a-e5685aa77c62 with scrape type 1
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_abb55135f4e7efe03173ba5fc65d05c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_abb55135f4e7efe03173ba5fc65d05c4.jpg not downloaded yet
2026-03-28 18:41:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 570a6cf2-3d36-548d-a588-b304d6f8cec9 with identifier: SV56483
2026-03-28 18:41:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 570a6cf2-3d36-548d-a588-b304d6f8cec9 with identifier: SV56483
2026-03-28 18:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 570a6cf2-3d36-548d-a588-b304d6f8cec9 with identifier: SV56483 to the API
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:12:39Z',
 'fuel_type': 'diesel',
 'id': '570a6cf2-3d36-548d-a588-b304d6f8cec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV56483',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 105542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'Fiat Talento 2.0 TwinTurbo Diesel Ecojet L1H1 1,0t Family',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t Family',
 'year': 2020}
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV56483%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [auto1.de] INFO: Saving data for SV56483: {'auction_closing_time': 1774883559.0, 'created_time': 1773426951.889034, 'last_price_update_time': 1774723309.250444}
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV56483') HTTP/1.1" 204 0
2026-03-28 18:41:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:49 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [auto1.de] INFO: Scrape type for ZM61762: 2
2026-03-28 18:41:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 245a47b7-5b3c-586b-a757-43fc46cd59ed with identifier: ZM61762
2026-03-28 18:41:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 245a47b7-5b3c-586b-a757-43fc46cd59ed with scrape type 2
2026-03-28 18:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 245a47b7-5b3c-586b-a757-43fc46cd59ed with scrape type 2
2026-03-28 18:41:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 245a47b7-5b3c-586b-a757-43fc46cd59ed, identifier: ZM61762
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_206546d602324a837a5aa3ed2276757c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_206546d602324a837a5aa3ed2276757c.jpg not downloaded yet
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_ddef6c2288cda5e3b4510985ff61e2a4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_ddef6c2288cda5e3b4510985ff61e2a4.jpg not downloaded yet
2026-03-28 18:41:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 245a47b7-5b3c-586b-a757-43fc46cd59ed with identifier: ZM61762
2026-03-28 18:41:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 245a47b7-5b3c-586b-a757-43fc46cd59ed with identifier: ZM61762
2026-03-28 18:41:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 245a47b7-5b3c-586b-a757-43fc46cd59ed with identifier: ZM61762 to the API
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:53:54Z',
 'fuel_type': 'petrol',
 'id': '245a47b7-5b3c-586b-a757-43fc46cd59ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM61762',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 74622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-31',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM61762%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [auto1.de] INFO: Saving data for ZM61762: {'auction_closing_time': 1774886034.0, 'created_time': 1774032277.045346, 'last_price_update_time': 1774723309.796749}
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM61762') HTTP/1.1" 204 0
2026-03-28 18:41:49 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-28 18:41:49 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [auto1.de] INFO: Scrape type for LJ25581: 1
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_58f802b5fbd7920a6994ce577d06f76c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_58f802b5fbd7920a6994ce577d06f76c.jpg not downloaded yet
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_4645ce4d182f380066ef4c2f5637908e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_4645ce4d182f380066ef4c2f5637908e.jpg not downloaded yet
2026-03-28 18:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CM42106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_26b6cd9cc28a2d52391e5a20df6ff63e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_e6cc0478738fc30f102870d431385664.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:49 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [auto1.de] INFO: Scrape type for LL75700: 2
2026-03-28 18:41:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18d71fc6-d2c6-5385-878b-0a9104141297 with identifier: LL75700
2026-03-28 18:41:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18d71fc6-d2c6-5385-878b-0a9104141297 with scrape type 2
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18d71fc6-d2c6-5385-878b-0a9104141297 with scrape type 2
2026-03-28 18:41:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18d71fc6-d2c6-5385-878b-0a9104141297, identifier: LL75700
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_a73b66d7e8e825ee471ef00f34486f2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_a73b66d7e8e825ee471ef00f34486f2a.jpg not downloaded yet
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_2cea791e8604de367858f27c928eda3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_2cea791e8604de367858f27c928eda3d.jpg not downloaded yet
2026-03-28 18:41:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18d71fc6-d2c6-5385-878b-0a9104141297 with identifier: LL75700
2026-03-28 18:41:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18d71fc6-d2c6-5385-878b-0a9104141297 with identifier: LL75700
2026-03-28 18:41:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18d71fc6-d2c6-5385-878b-0a9104141297 with identifier: LL75700 to the API
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:03:17Z',
 'fuel_type': 'diesel',
 'id': '18d71fc6-d2c6-5385-878b-0a9104141297',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL75700',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 324484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 111 CDI Lang',
 'transmission': 'automatic',
 'trim': 'Lang',
 'year': 2008}
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL75700%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [auto1.de] INFO: Saving data for LL75700: {'auction_closing_time': 1774882997.0, 'created_time': 1773467782.768771, 'last_price_update_time': 1774723310.501588}
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL75700') HTTP/1.1" 204 0
2026-03-28 18:41:50 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_cc66d87b8b858ae77e74ca858fa0c269.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc66d87b8b858ae77e74ca858fa0c269.jpg not downloaded yet
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_dff80d23ce9d631a5d013f556829b867.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_dff80d23ce9d631a5d013f556829b867.jpg not downloaded yet
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_469862a4701fedb72e1d466b27d5f7a7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_469862a4701fedb72e1d466b27d5f7a7.jpg not downloaded yet
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_0688c4ea287b1bf3f419463743a59f1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_0688c4ea287b1bf3f419463743a59f1b.jpg not downloaded yet
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2aed90>
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_26b6cd9cc28a2d52391e5a20df6ff63e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_26b6cd9cc28a2d52391e5a20df6ff63e.jpg saved to cache
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d1610>
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_e6cc0478738fc30f102870d431385664.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_e6cc0478738fc30f102870d431385664.jpg saved to cache
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_5e105d4542fb68fe31ff4a78a3679137.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_5e105d4542fb68fe31ff4a78a3679137.jpg not downloaded yet
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_3121fcf2830ac0df7c7b2550b7f7eb10.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_3121fcf2830ac0df7c7b2550b7f7eb10.jpg not downloaded yet
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_4645ce4d182f380066ef4c2f5637908e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_6cb7c7ce2ea29278d01062d76e954f49.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_6cb7c7ce2ea29278d01062d76e954f49.jpg not downloaded yet
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_e0748d7d428cd0ea59c149ffe47d0f43.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_e0748d7d428cd0ea59c149ffe47d0f43.jpg not downloaded yet
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PR51827/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_f5487c5c28252227e0e58bce545f66a9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_f5487c5c28252227e0e58bce545f66a9.jpg not downloaded yet
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_a5ea7c393d8e36e9d9cc6c27582f6307.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_a5ea7c393d8e36e9d9cc6c27582f6307.jpg not downloaded yet
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_58f802b5fbd7920a6994ce577d06f76c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_228d40e67cdb04af4d9d7fd940a4a823.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_228d40e67cdb04af4d9d7fd940a4a823.jpg not downloaded yet
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_489f51e6f8b4bb862f4ff82e100783a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_489f51e6f8b4bb862f4ff82e100783a8.jpg not downloaded yet
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b58bb8190>
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_4645ce4d182f380066ef4c2f5637908e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_4645ce4d182f380066ef4c2f5637908e.jpg saved to cache
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_3121fcf2830ac0df7c7b2550b7f7eb10.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_924b56e2e0c955a1a8ce72fc375d31ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_a5ea7c393d8e36e9d9cc6c27582f6307.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_1ec901e10ad964df66772edd1cd880e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd50210>
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_58f802b5fbd7920a6994ce577d06f76c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_58f802b5fbd7920a6994ce577d06f76c.jpg saved to cache
2026-03-28 18:41:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_489f51e6f8b4bb862f4ff82e100783a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_9a0e10b9549d0c5e39a174d371a1369e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_5dfe508d0139dcc56f828faf4493a82f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_95fbd48daaa6b66726e0e157381f6103.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda2cd0>
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_3121fcf2830ac0df7c7b2550b7f7eb10.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_3121fcf2830ac0df7c7b2550b7f7eb10.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bde50d0>
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_924b56e2e0c955a1a8ce72fc375d31ea.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_924b56e2e0c955a1a8ce72fc375d31ea.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcc3110>
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_a5ea7c393d8e36e9d9cc6c27582f6307.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_a5ea7c393d8e36e9d9cc6c27582f6307.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b079b50>
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_1ec901e10ad964df66772edd1cd880e3.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_1ec901e10ad964df66772edd1cd880e3.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_228d40e67cdb04af4d9d7fd940a4a823.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HU15676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DG41556/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0a7d0>
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_489f51e6f8b4bb862f4ff82e100783a8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_489f51e6f8b4bb862f4ff82e100783a8.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b11e610>
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_9a0e10b9549d0c5e39a174d371a1369e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_9a0e10b9549d0c5e39a174d371a1369e.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:41:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb62d0>
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_5dfe508d0139dcc56f828faf4493a82f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_5dfe508d0139dcc56f828faf4493a82f.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:41:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b181090>
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_95fbd48daaa6b66726e0e157381f6103.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_95fbd48daaa6b66726e0e157381f6103.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AW19440/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b183090>
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_228d40e67cdb04af4d9d7fd940a4a823.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_228d40e67cdb04af4d9d7fd940a4a823.jpg saved to cache
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC34212> (referer: https://www.auto1.com/v1/car-details-view/AC34212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT85364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GK39429/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LJ25581/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_e0748d7d428cd0ea59c149ffe47d0f43.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_6cb7c7ce2ea29278d01062d76e954f49.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15256595-7396-5306-8764-6653f86c51be with identifier: AC34212
2026-03-28 18:41:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15256595-7396-5306-8764-6653f86c51be with scrape type 1
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_400a95d928b13f2186f7c9ba8d9810e7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_400a95d928b13f2186f7c9ba8d9810e7.jpg not downloaded yet
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_f5487c5c28252227e0e58bce545f66a9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_3cc1885f7f077c3bcfe0f7eff14426aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_3cc1885f7f077c3bcfe0f7eff14426aa.jpg not downloaded yet
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_a73b66d7e8e825ee471ef00f34486f2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_2cea791e8604de367858f27c928eda3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_2f5c4d2a8b2f68ef513af19d85ae4ea8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_2f5c4d2a8b2f68ef513af19d85ae4ea8.jpg not downloaded yet
2026-03-28 18:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_a078081fad0d952f66e74814fbeb0239.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a078081fad0d952f66e74814fbeb0239.jpg not downloaded yet
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_5e105d4542fb68fe31ff4a78a3679137.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_67217f0654a52f94a7931b111b138e66.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_67217f0654a52f94a7931b111b138e66.jpg not downloaded yet
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b069290>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_e0748d7d428cd0ea59c149ffe47d0f43.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_e0748d7d428cd0ea59c149ffe47d0f43.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fde450>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_6cb7c7ce2ea29278d01062d76e954f49.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_6cb7c7ce2ea29278d01062d76e954f49.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc66d87b8b858ae77e74ca858fa0c269.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_469862a4701fedb72e1d466b27d5f7a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_400a95d928b13f2186f7c9ba8d9810e7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_206546d602324a837a5aa3ed2276757c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_682d6d827f97d6d65de3b1d764c74869.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_682d6d827f97d6d65de3b1d764c74869.jpg not downloaded yet
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd34650>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_f5487c5c28252227e0e58bce545f66a9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_f5487c5c28252227e0e58bce545f66a9.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc99fd0>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_a73b66d7e8e825ee471ef00f34486f2a.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_a73b66d7e8e825ee471ef00f34486f2a.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1d0d0>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_2cea791e8604de367858f27c928eda3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_2cea791e8604de367858f27c928eda3d.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_a2d774be8d0280c6578e01af317a367b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a2d774be8d0280c6578e01af317a367b.jpg not downloaded yet
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a078081fad0d952f66e74814fbeb0239.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_2f5c4d2a8b2f68ef513af19d85ae4ea8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02bd90>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_5e105d4542fb68fe31ff4a78a3679137.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_5e105d4542fb68fe31ff4a78a3679137.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_1866588d6d85a5b2538a007f92d92760.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_1866588d6d85a5b2538a007f92d92760.jpg not downloaded yet
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_3cc1885f7f077c3bcfe0f7eff14426aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_380b43c68946503fffbbd9fa11bc8cbb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_380b43c68946503fffbbd9fa11bc8cbb.jpg not downloaded yet
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be916d0>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_cc66d87b8b858ae77e74ca858fa0c269.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc66d87b8b858ae77e74ca858fa0c269.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbef910>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_469862a4701fedb72e1d466b27d5f7a7.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_469862a4701fedb72e1d466b27d5f7a7.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beaca90>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_400a95d928b13f2186f7c9ba8d9810e7.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_400a95d928b13f2186f7c9ba8d9810e7.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beb06d0>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_206546d602324a837a5aa3ed2276757c.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_206546d602324a837a5aa3ed2276757c.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_a638c71a7a52e4c5b5135ace7c15ef85.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a638c71a7a52e4c5b5135ace7c15ef85.jpg not downloaded yet
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcd6250>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_a078081fad0d952f66e74814fbeb0239.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a078081fad0d952f66e74814fbeb0239.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcc0f50>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_2f5c4d2a8b2f68ef513af19d85ae4ea8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_2f5c4d2a8b2f68ef513af19d85ae4ea8.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb62650>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_3cc1885f7f077c3bcfe0f7eff14426aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_3cc1885f7f077c3bcfe0f7eff14426aa.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_1866588d6d85a5b2538a007f92d92760.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PR51827> (referer: https://www.auto1.com/v1/car-details-view/PR51827/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_0688c4ea287b1bf3f419463743a59f1b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a638c71a7a52e4c5b5135ace7c15ef85.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_380b43c68946503fffbbd9fa11bc8cbb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CM42106> (referer: https://www.auto1.com/v1/car-details-view/CM42106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b064650>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_1866588d6d85a5b2538a007f92d92760.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_1866588d6d85a5b2538a007f92d92760.jpg saved to cache
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with identifier: PR51827
2026-03-28 18:41:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with scrape type 1
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_2436c8ac126b1a035a8bb6aaf4f90f87.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_2436c8ac126b1a035a8bb6aaf4f90f87.jpg not downloaded yet
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_dff80d23ce9d631a5d013f556829b867.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_2a8d11fd562335ad3d224c73f0fa57ed.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_2a8d11fd562335ad3d224c73f0fa57ed.jpg not downloaded yet
2026-03-28 18:41:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc6b48634817c517c364fe5644141c36.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_c8df59fed8fac97fd8875207e196fc8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_c8df59fed8fac97fd8875207e196fc8e.jpg not downloaded yet
2026-03-28 18:41:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb075d0>
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_0688c4ea287b1bf3f419463743a59f1b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_0688c4ea287b1bf3f419463743a59f1b.jpg saved to cache
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bed8f90>
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_a638c71a7a52e4c5b5135ace7c15ef85.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a638c71a7a52e4c5b5135ace7c15ef85.jpg saved to cache
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbda4d0>
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_380b43c68946503fffbbd9fa11bc8cbb.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_380b43c68946503fffbbd9fa11bc8cbb.jpg saved to cache
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8d503b6-daeb-562a-9db6-a4711381220d with identifier: CM42106
2026-03-28 18:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8d503b6-daeb-562a-9db6-a4711381220d with scrape type 1
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_5fe5386657722a1188f95fc638bfa0d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_5fe5386657722a1188f95fc638bfa0d8.jpg not downloaded yet
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_67217f0654a52f94a7931b111b138e66.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_cd56eb0a4dd363817226cf0661d15d62.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_cd56eb0a4dd363817226cf0661d15d62.jpg not downloaded yet
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a2d774be8d0280c6578e01af317a367b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_6dadd0bff0932d01a21812c696cdfcce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_6dadd0bff0932d01a21812c696cdfcce.jpg not downloaded yet
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_ddef6c2288cda5e3b4510985ff61e2a4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_682d6d827f97d6d65de3b1d764c74869.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_42d12bbc90c7c2a26e84aa390dd914fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_42d12bbc90c7c2a26e84aa390dd914fd.jpg not downloaded yet
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DG41556> (referer: https://www.auto1.com/v1/car-details-view/DG41556/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LJ25581> (referer: https://www.auto1.com/v1/car-details-view/LJ25581/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT85364> (referer: https://www.auto1.com/v1/car-details-view/XT85364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_799061b74694bd8a3187ffdbae5d1215.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_799061b74694bd8a3187ffdbae5d1215.jpg not downloaded yet
2026-03-28 18:41:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_a31713609ad1b2926027e90a64a9d161.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_a31713609ad1b2926027e90a64a9d161.jpg not downloaded yet
2026-03-28 18:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ39198> (referer: https://www.auto1.com/v1/car-details-view/KJ39198/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc1df90>
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_dff80d23ce9d631a5d013f556829b867.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_dff80d23ce9d631a5d013f556829b867.jpg saved to cache
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb3a50>
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgba%252F67%252Fba67993bf97146e53fe6c989f20493d7%252Fpa%252FCJ73141_cc6b48634817c517c364fe5644141c36.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc6b48634817c517c364fe5644141c36.jpg saved to cache
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d8948d1-6f87-5de2-90fe-acc74013515e
2026-03-28 18:41:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d8948d1-6f87-5de2-90fe-acc74013515e, skipping ID generation
2026-03-28 18:41:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d8948d1-6f87-5de2-90fe-acc74013515e with scrape type 1
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d8948d1-6f87-5de2-90fe-acc74013515e sending to next pipeline
2026-03-28 18:41:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d8948d1-6f87-5de2-90fe-acc74013515e, identifier: CJ73141
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_48543df16f6a6538a17e8bf165027007.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_48543df16f6a6538a17e8bf165027007.jpg not downloaded yet
2026-03-28 18:41:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d8948d1-6f87-5de2-90fe-acc74013515e with identifier: CJ73141
2026-03-28 18:41:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d8948d1-6f87-5de2-90fe-acc74013515e with identifier: CJ73141
2026-03-28 18:41:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d8948d1-6f87-5de2-90fe-acc74013515e with identifier: CJ73141 to the API
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc6b48634817c517c364fe5644141c36.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:01:12Z',
 'fuel_type': 'petrol',
 'id': '4d8948d1-6f87-5de2-90fe-acc74013515e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ73141',
 'listing': 'auction',
 'location': 'DE, Aachen',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 27357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc6b48634817c517c364fe5644141c36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79907,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_206546d602324a837a5aa3ed2276757c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_58f802b5fbd7920a6994ce577d06f76c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_a73b66d7e8e825ee471ef00f34486f2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77069,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_cc66d87b8b858ae77e74ca858fa0c269.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90841,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_469862a4701fedb72e1d466b27d5f7a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_5e105d4542fb68fe31ff4a78a3679137.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_6cb7c7ce2ea29278d01062d76e954f49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_f5487c5c28252227e0e58bce545f66a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d8948d1-6f87-5de2-90fe-acc74013515e/4d8948d1-6f87-5de2-90fe-acc74013515e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgba/67/ba67993bf97146e53fe6c989f20493d7/pa/CJ73141_228d40e67cdb04af4d9d7fd940a4a823.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-12-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2010}
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ73141%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [auto1.de] INFO: Saving data for CJ73141: {'created_time': 1774723314.106224, 'last_price_update_time': 1774723314.106243, 'auction_closing_time': 1774882872.0}
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ73141') HTTP/1.1" 204 0
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_070f22886dc60ee580d4e2d3b781e785.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_070f22886dc60ee580d4e2d3b781e785.jpg not downloaded yet
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_ef3bfd72e2470caad23a202cc15b3f84.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_ef3bfd72e2470caad23a202cc15b3f84.jpg not downloaded yet
2026-03-28 18:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GK39429> (referer: https://www.auto1.com/v1/car-details-view/GK39429/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AW19440> (referer: https://www.auto1.com/v1/car-details-view/AW19440/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_4f9e209141723d6cfff1f1cc3bddae46.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_4f9e209141723d6cfff1f1cc3bddae46.jpg not downloaded yet
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_b62211bc87216f2c0f73efeac90f5374.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b62211bc87216f2c0f73efeac90f5374.jpg not downloaded yet
2026-03-28 18:41:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b151a90>
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_67217f0654a52f94a7931b111b138e66.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_67217f0654a52f94a7931b111b138e66.jpg saved to cache
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd16f10>
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_a2d774be8d0280c6578e01af317a367b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a2d774be8d0280c6578e01af317a367b.jpg saved to cache
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1613d0>
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_ddef6c2288cda5e3b4510985ff61e2a4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_ddef6c2288cda5e3b4510985ff61e2a4.jpg saved to cache
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd99e90>
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252Fbd%252F6cbd3e7edaab36a98dc1c0ac9ba296b2%252Fpa%252FAC34212_682d6d827f97d6d65de3b1d764c74869.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_682d6d827f97d6d65de3b1d764c74869.jpg saved to cache
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 15256595-7396-5306-8764-6653f86c51be
2026-03-28 18:41:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 15256595-7396-5306-8764-6653f86c51be, skipping ID generation
2026-03-28 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15256595-7396-5306-8764-6653f86c51be with scrape type 1
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 15256595-7396-5306-8764-6653f86c51be sending to next pipeline
2026-03-28 18:41:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15256595-7396-5306-8764-6653f86c51be, identifier: AC34212
2026-03-28 18:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c319f9a-0510-5652-bedf-1c6f9351daf0 with identifier: DG41556
2026-03-28 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c319f9a-0510-5652-bedf-1c6f9351daf0 with scrape type 1
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_1ce8c6fcedb4467af014310b41615807.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_1ce8c6fcedb4467af014310b41615807.jpg not downloaded yet
2026-03-28 18:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with identifier: LJ25581
2026-03-28 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with scrape type 1
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_deddc3e096cdca0aeca44c995f9d9613.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_deddc3e096cdca0aeca44c995f9d9613.jpg not downloaded yet
2026-03-28 18:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with identifier: XT85364
2026-03-28 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with scrape type 1
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_f82fe6cab959ba0425a627928dcb465b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_f82fe6cab959ba0425a627928dcb465b.jpg not downloaded yet
2026-03-28 18:41:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with identifier: KJ39198
2026-03-28 18:41:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with scrape type 1
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_44455ea305fc78d68290864fb5b8c7b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_44455ea305fc78d68290864fb5b8c7b1.jpg not downloaded yet
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_e8cd13372eb20bc90da51b069ffc587e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_e8cd13372eb20bc90da51b069ffc587e.jpg not downloaded yet
2026-03-28 18:41:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15256595-7396-5306-8764-6653f86c51be with identifier: AC34212
2026-03-28 18:41:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15256595-7396-5306-8764-6653f86c51be with identifier: AC34212
2026-03-28 18:41:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15256595-7396-5306-8764-6653f86c51be with identifier: AC34212 to the API
2026-03-28 18:41:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_682d6d827f97d6d65de3b1d764c74869.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:42Z',
 'fuel_type': 'diesel',
 'id': '15256595-7396-5306-8764-6653f86c51be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC34212',
 'listing': 'auction',
 'location': 'DE, Velen-Ramsdorf',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 127192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_400a95d928b13f2186f7c9ba8d9810e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_3cc1885f7f077c3bcfe0f7eff14426aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60539,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_2f5c4d2a8b2f68ef513af19d85ae4ea8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a078081fad0d952f66e74814fbeb0239.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2443174,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_67217f0654a52f94a7931b111b138e66.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380674,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_682d6d827f97d6d65de3b1d764c74869.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53437,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a2d774be8d0280c6578e01af317a367b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_1866588d6d85a5b2538a007f92d92760.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58557,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_380b43c68946503fffbbd9fa11bc8cbb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15256595-7396-5306-8764-6653f86c51be/15256595-7396-5306-8764-6653f86c51be_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/bd/6cbd3e7edaab36a98dc1c0ac9ba296b2/pa/AC34212_a638c71a7a52e4c5b5135ace7c15ef85.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2012}
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC34212%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [auto1.de] INFO: Saving data for AC34212: {'created_time': 1774723315.300926, 'last_price_update_time': 1774723315.300937, 'auction_closing_time': 1774883802.0}
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC34212') HTTP/1.1" 204 0
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_713d9d3c1456e7a2a66b29f3ac217c3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_713d9d3c1456e7a2a66b29f3ac217c3d.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_a7ae39374774c72857363645697376d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a7ae39374774c72857363645697376d1.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_bb5bb04486bbc07ad36cb70d1ea0e3f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_bb5bb04486bbc07ad36cb70d1ea0e3f7.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_1eb64b8c0e637c201eee61294a9e4093.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_1eb64b8c0e637c201eee61294a9e4093.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_3f38dfdc200435daf17d9a9adc80c543.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_3f38dfdc200435daf17d9a9adc80c543.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_7f72b7297b538924744f09741c19d57b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_7f72b7297b538924744f09741c19d57b.jpg not downloaded yet
2026-03-28 18:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX55373/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HU15676> (referer: https://www.auto1.com/v1/car-details-view/HU15676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 001744d9-d648-5516-96cb-92e98eaff057 with identifier: GK39429
2026-03-28 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 001744d9-d648-5516-96cb-92e98eaff057 with scrape type 1
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 001744d9-d648-5516-96cb-92e98eaff057
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_bdd1677ef3015558a8583d35645afd12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_bdd1677ef3015558a8583d35645afd12.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_9735d0f29de207384ef8c80e5d5c7d40.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_9735d0f29de207384ef8c80e5d5c7d40.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_3ee4d8e77b7e680b075681d53f852a83.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_3ee4d8e77b7e680b075681d53f852a83.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_e30a61e8c8c4e1e4e82b1c4f063f7a6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_e30a61e8c8c4e1e4e82b1c4f063f7a6e.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_65917b22e96e5ba851c09b974229ca73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_65917b22e96e5ba851c09b974229ca73.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_3885e363a1f286a43ae3a7bdadcee0f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_3885e363a1f286a43ae3a7bdadcee0f1.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_f541fa0c591518f220b7e0bd6aea5696.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_f541fa0c591518f220b7e0bd6aea5696.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_d9309e87a57accabd1cdd4673e6d3eac.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_d9309e87a57accabd1cdd4673e6d3eac.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_5f9751760837a49b044c911d508d915c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_5f9751760837a49b044c911d508d915c.jpg already downloaded
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F2c%252F522caa9b511ca5bb6e46d5a23fc5a086%252Fpa%252FGK39429_90d76bed45b33294b5b877c69308b6af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_90d76bed45b33294b5b877c69308b6af.jpg already downloaded
2026-03-28 18:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 001744d9-d648-5516-96cb-92e98eaff057, identifier: GK39429
2026-03-28 18:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 776fe438-d8b0-541c-bf45-929e52bcf37e with identifier: AW19440
2026-03-28 18:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776fe438-d8b0-541c-bf45-929e52bcf37e with scrape type 1
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_237a2a8f0ad27eb504bb610e051fa3bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_237a2a8f0ad27eb504bb610e051fa3bd.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_b5b69514a079202faa384148b50c8f9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b5b69514a079202faa384148b50c8f9a.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_e75a907c129c96a45295025dcf802e78.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_e75a907c129c96a45295025dcf802e78.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_b25169671a97ae1fe0e81c98d72d98da.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_b25169671a97ae1fe0e81c98d72d98da.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_93c54740aeff74b66ae5ab62cf5f7fe5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_93c54740aeff74b66ae5ab62cf5f7fe5.jpg not downloaded yet
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_187de1446c11e874885fa2d9b2a9ba48.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_187de1446c11e874885fa2d9b2a9ba48.jpg not downloaded yet
2026-03-28 18:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 001744d9-d648-5516-96cb-92e98eaff057 with identifier: GK39429
2026-03-28 18:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 001744d9-d648-5516-96cb-92e98eaff057 with identifier: GK39429
2026-03-28 18:41:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 001744d9-d648-5516-96cb-92e98eaff057 with identifier: GK39429 to the API
2026-03-28 18:41:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GK39429>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:16:40Z',
 'fuel_type': 'diesel',
 'id': '001744d9-d648-5516-96cb-92e98eaff057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK39429',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 111702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_bdd1677ef3015558a8583d35645afd12.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_9735d0f29de207384ef8c80e5d5c7d40.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_3ee4d8e77b7e680b075681d53f852a83.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_e30a61e8c8c4e1e4e82b1c4f063f7a6e.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_65917b22e96e5ba851c09b974229ca73.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_3885e363a1f286a43ae3a7bdadcee0f1.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_f541fa0c591518f220b7e0bd6aea5696.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_d9309e87a57accabd1cdd4673e6d3eac.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_5f9751760837a49b044c911d508d915c.jpg',
                'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_90d76bed45b33294b5b877c69308b6af.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_bdd1677ef3015558a8583d35645afd12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_9735d0f29de207384ef8c80e5d5c7d40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_3ee4d8e77b7e680b075681d53f852a83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_e30a61e8c8c4e1e4e82b1c4f063f7a6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_65917b22e96e5ba851c09b974229ca73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_3885e363a1f286a43ae3a7bdadcee0f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59287,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_f541fa0c591518f220b7e0bd6aea5696.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_d9309e87a57accabd1cdd4673e6d3eac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_5f9751760837a49b044c911d508d915c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_001744d9-d648-5516-96cb-92e98eaff057/001744d9-d648-5516-96cb-92e98eaff057_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/2c/522caa9b511ca5bb6e46d5a23fc5a086/pa/GK39429_90d76bed45b33294b5b877c69308b6af.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK39429%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [auto1.de] INFO: Saving data for GK39429: {'created_time': 1774723316.156469, 'last_price_update_time': 1774723316.156481, 'auction_closing_time': 1774883800.0}
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK39429') HTTP/1.1" 204 0
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_d6d7df1b5db2a4cf9df4922fbd43ae3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_d6d7df1b5db2a4cf9df4922fbd43ae3f.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_58b4fc9ea5c18c03031b2383878ed8a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_58b4fc9ea5c18c03031b2383878ed8a2.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_88d16b18a536c5a3070d8c4dd7aa25e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_88d16b18a536c5a3070d8c4dd7aa25e4.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_0ca42d221b838ec487be525cc06b1ca6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_0ca42d221b838ec487be525cc06b1ca6.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_57d6eae59cf5b556f2675d74ef8c471d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_57d6eae59cf5b556f2675d74ef8c471d.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_209a6900fcd675c55756ecf68c492caa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_209a6900fcd675c55756ecf68c492caa.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_2921688e1d3fcbbe36985dcf9413e914.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2921688e1d3fcbbe36985dcf9413e914.jpg not downloaded yet
2026-03-28 18:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9b1eaee-f224-5986-b97d-5ef427717390 with identifier: HU15676
2026-03-28 18:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b1eaee-f224-5986-b97d-5ef427717390 with scrape type 1
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_18bafecd2274f03b9fcaf719740abcde.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_18bafecd2274f03b9fcaf719740abcde.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_ac97c4fad9b95a6b03100acd0b850119.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_ac97c4fad9b95a6b03100acd0b850119.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_02d76d19def3fcd3dce71928edeae5a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_02d76d19def3fcd3dce71928edeae5a1.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_ed34c53f06c6d3ea39e03168b5c87f7f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_ed34c53f06c6d3ea39e03168b5c87f7f.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_8618d041dd45b271f6fe5db4f620c7fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_8618d041dd45b271f6fe5db4f620c7fe.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_386c6330d319a976e42ed175d62c24cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_386c6330d319a976e42ed175d62c24cc.jpg not downloaded yet
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_bb5bb04486bbc07ad36cb70d1ea0e3f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_44455ea305fc78d68290864fb5b8c7b1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_2223175290cde3f7e7f6ff03637af857.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2223175290cde3f7e7f6ff03637af857.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_d095116b0ecca58808ae40acb7b8296d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_d095116b0ecca58808ae40acb7b8296d.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_9f021cb48361db3dd6645949a798c7f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_9f021cb48361db3dd6645949a798c7f9.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_d8d790f311ab686363dcc31d720352a8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_d8d790f311ab686363dcc31d720352a8.jpg not downloaded yet
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN44220> (referer: https://www.auto1.com/v1/car-details-view/BN44220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_713d9d3c1456e7a2a66b29f3ac217c3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_3f38dfdc200435daf17d9a9adc80c543.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_fec1c681f82503efa0c034ad5d728953.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_fec1c681f82503efa0c034ad5d728953.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_5896716e5668e8adad1d2838e45f88f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_5896716e5668e8adad1d2838e45f88f1.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_a2f45ef1caf46929df96c097da0b2494.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a2f45ef1caf46929df96c097da0b2494.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_dd73eb7a68bbcce59d42e1e6d3521487.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_dd73eb7a68bbcce59d42e1e6d3521487.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_9c24d3cb638c935ccb6121e0d35f8c13.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_9c24d3cb638c935ccb6121e0d35f8c13.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_c9d14f6198a778b5c4931ea45b5dca18.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_c9d14f6198a778b5c4931ea45b5dca18.jpg not downloaded yet
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_f82fe6cab959ba0425a627928dcb465b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_deddc3e096cdca0aeca44c995f9d9613.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_a480c1142f95e925870b0fab5fe8c089.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a480c1142f95e925870b0fab5fe8c089.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_2927fd1d78b491efd0ab1c7f71873cfa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_2927fd1d78b491efd0ab1c7f71873cfa.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_6e3e9e2599fcab027a9fb72830754182.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_6e3e9e2599fcab027a9fb72830754182.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_53a2cf7e7e53efc122bb0335ba082634.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_53a2cf7e7e53efc122bb0335ba082634.jpg not downloaded yet
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b28ab10>
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_bb5bb04486bbc07ad36cb70d1ea0e3f7.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_bb5bb04486bbc07ad36cb70d1ea0e3f7.jpg saved to cache
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bde6250>
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_44455ea305fc78d68290864fb5b8c7b1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_44455ea305fc78d68290864fb5b8c7b1.jpg saved to cache
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_1ce8c6fcedb4467af014310b41615807.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_8024f64dc80b8ca767345ff812623371.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_8024f64dc80b8ca767345ff812623371.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_3c809bf79d3ed7bac15626741cf9d421.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_3c809bf79d3ed7bac15626741cf9d421.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_2f90d65b6239a8de5b82de91fb2ab7f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2f90d65b6239a8de5b82de91fb2ab7f9.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_e4e3a0f116822bbc41bb25484849e283.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_e4e3a0f116822bbc41bb25484849e283.jpg not downloaded yet
2026-03-28 18:41:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with identifier: BN44220
2026-03-28 18:41:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with scrape type 1
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_32a218003de7e4c53a51d7ac4647ef44.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_32a218003de7e4c53a51d7ac4647ef44.jpg not downloaded yet
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2eead0>
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_713d9d3c1456e7a2a66b29f3ac217c3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_713d9d3c1456e7a2a66b29f3ac217c3d.jpg saved to cache
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b113d10>
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_3f38dfdc200435daf17d9a9adc80c543.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_3f38dfdc200435daf17d9a9adc80c543.jpg saved to cache
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b62211bc87216f2c0f73efeac90f5374.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_c5a0512b44f88922be791ccbe24117bd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_c5a0512b44f88922be791ccbe24117bd.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_69695ea1263424ba637e5f520a49f8fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_69695ea1263424ba637e5f520a49f8fe.jpg not downloaded yet
2026-03-28 18:41:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_4f9e209141723d6cfff1f1cc3bddae46.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_4483251c8352a67d14ef2f133209bdf0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_4483251c8352a67d14ef2f133209bdf0.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_b7e3f6a011b8b3ca330cbb803fb88a4f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_b7e3f6a011b8b3ca330cbb803fb88a4f.jpg not downloaded yet
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_bf84db33a06d42da07e5f762f45f4f0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_bf84db33a06d42da07e5f762f45f4f0f.jpg not downloaded yet
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd692d0>
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_f82fe6cab959ba0425a627928dcb465b.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_f82fe6cab959ba0425a627928dcb465b.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc15990>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_deddc3e096cdca0aeca44c995f9d9613.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_deddc3e096cdca0aeca44c995f9d9613.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16c510>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_1ce8c6fcedb4467af014310b41615807.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_1ce8c6fcedb4467af014310b41615807.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_024d5b8a920a72c5ab268ec1e5499801.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_024d5b8a920a72c5ab268ec1e5499801.jpg not downloaded yet
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_e3d8ed4f8ee48683c0ae7aecadbc8107.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_e3d8ed4f8ee48683c0ae7aecadbc8107.jpg not downloaded yet
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_203b02a60f356a1cfc2aa1af1f3bc4e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_203b02a60f356a1cfc2aa1af1f3bc4e4.jpg not downloaded yet
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_070f22886dc60ee580d4e2d3b781e785.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_3f6f368361c9221558d7fe76e603b820.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_3f6f368361c9221558d7fe76e603b820.jpg not downloaded yet
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_132a3015254d69ed862d4067d9e6fae2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_132a3015254d69ed862d4067d9e6fae2.jpg not downloaded yet
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb5d650>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_b62211bc87216f2c0f73efeac90f5374.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b62211bc87216f2c0f73efeac90f5374.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c4810>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_4f9e209141723d6cfff1f1cc3bddae46.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_4f9e209141723d6cfff1f1cc3bddae46.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_386c6330d319a976e42ed175d62c24cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_a0a5bffaef84ca5a1638db0434b52204.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_a0a5bffaef84ca5a1638db0434b52204.jpg not downloaded yet
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_d69baafe761a78b568a334f7c3af28e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_d69baafe761a78b568a334f7c3af28e8.jpg not downloaded yet
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_b33db9275be40f7346a8c504747034d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_b33db9275be40f7346a8c504747034d8.jpg not downloaded yet
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b21b5d0>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_070f22886dc60ee580d4e2d3b781e785.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_070f22886dc60ee580d4e2d3b781e785.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_8618d041dd45b271f6fe5db4f620c7fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_754b794ebad8961f743980c4595668d7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_754b794ebad8961f743980c4595668d7.jpg not downloaded yet
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_d8d790f311ab686363dcc31d720352a8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_591c223410b0dff560f6f8139ceeeb9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_591c223410b0dff560f6f8139ceeeb9e.jpg not downloaded yet
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_a0decb497c2e7b26987a1ff8384711f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_a0decb497c2e7b26987a1ff8384711f4.jpg not downloaded yet
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ff4790>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_386c6330d319a976e42ed175d62c24cc.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_386c6330d319a976e42ed175d62c24cc.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_abb55135f4e7efe03173ba5fc65d05c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_22a96513178cba20e5e8c8e830f26dc0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_22a96513178cba20e5e8c8e830f26dc0.jpg not downloaded yet
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c7890>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_8618d041dd45b271f6fe5db4f620c7fe.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_8618d041dd45b271f6fe5db4f620c7fe.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_9f021cb48361db3dd6645949a798c7f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b152490>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_d8d790f311ab686363dcc31d720352a8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_d8d790f311ab686363dcc31d720352a8.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a7ae39374774c72857363645697376d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_e8cd13372eb20bc90da51b069ffc587e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b105350>
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F48%252F7848043a2803b0192c1f7eed6f7a75b6%252Fpa%252FVR01975_abb55135f4e7efe03173ba5fc65d05c4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_abb55135f4e7efe03173ba5fc65d05c4.jpg saved to cache
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 665e0565-4699-51e9-906a-e5685aa77c62
2026-03-28 18:41:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 665e0565-4699-51e9-906a-e5685aa77c62, skipping ID generation
2026-03-28 18:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 665e0565-4699-51e9-906a-e5685aa77c62 with scrape type 1
2026-03-28 18:41:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 665e0565-4699-51e9-906a-e5685aa77c62 sending to next pipeline
2026-03-28 18:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 665e0565-4699-51e9-906a-e5685aa77c62, identifier: VR01975
2026-03-28 18:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 665e0565-4699-51e9-906a-e5685aa77c62 with identifier: VR01975
2026-03-28 18:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 665e0565-4699-51e9-906a-e5685aa77c62 with identifier: VR01975
2026-03-28 18:41:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 665e0565-4699-51e9-906a-e5685aa77c62 with identifier: VR01975 to the API
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_abb55135f4e7efe03173ba5fc65d05c4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:34Z',
 'fuel_type': 'petrol',
 'id': '665e0565-4699-51e9-906a-e5685aa77c62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR01975',
 'listing': 'auction',
 'location': 'DE, Stuttgart',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 45320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3081986,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_abb55135f4e7efe03173ba5fc65d05c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959724,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_ddef6c2288cda5e3b4510985ff61e2a4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_4645ce4d182f380066ef4c2f5637908e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_2cea791e8604de367858f27c928eda3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3201382,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_dff80d23ce9d631a5d013f556829b867.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896786,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_0688c4ea287b1bf3f419463743a59f1b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55493,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_3121fcf2830ac0df7c7b2550b7f7eb10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79674,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_e0748d7d428cd0ea59c149ffe47d0f43.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_a5ea7c393d8e36e9d9cc6c27582f6307.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_665e0565-4699-51e9-906a-e5685aa77c62/665e0565-4699-51e9-906a-e5685aa77c62_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66740,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/48/7848043a2803b0192c1f7eed6f7a75b6/pa/VR01975_489f51e6f8b4bb862f4ff82e100783a8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Scenic 1.6 TomTom Edition',
 'transmission': 'manual',
 'trim': 'TomTom Edition',
 'year': 2012}
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01975%27 HTTP/1.1" 200 None
2026-03-28 18:41:58 [auto1.de] INFO: Saving data for VR01975: {'created_time': 1774723318.356079, 'last_price_update_time': 1774723318.356091, 'auction_closing_time': 1774885294.0}
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR01975') HTTP/1.1" 204 0
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_d095116b0ecca58808ae40acb7b8296d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_c9d14f6198a778b5c4931ea45b5dca18.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_53a2cf7e7e53efc122bb0335ba082634.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd69210>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_9f021cb48361db3dd6645949a798c7f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_9f021cb48361db3dd6645949a798c7f9.jpg saved to cache
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:41:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b106150>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_a7ae39374774c72857363645697376d1.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a7ae39374774c72857363645697376d1.jpg saved to cache
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:41:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10f290>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_e8cd13372eb20bc90da51b069ffc587e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_e8cd13372eb20bc90da51b069ffc587e.jpg saved to cache
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_1eb64b8c0e637c201eee61294a9e4093.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_132a3015254d69ed862d4067d9e6fae2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_bf84db33a06d42da07e5f762f45f4f0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc9fa90>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_d095116b0ecca58808ae40acb7b8296d.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_d095116b0ecca58808ae40acb7b8296d.jpg saved to cache
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b205750>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_c9d14f6198a778b5c4931ea45b5dca18.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_c9d14f6198a778b5c4931ea45b5dca18.jpg saved to cache
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02e4d0>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_53a2cf7e7e53efc122bb0335ba082634.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_53a2cf7e7e53efc122bb0335ba082634.jpg saved to cache
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_b33db9275be40f7346a8c504747034d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_a0decb497c2e7b26987a1ff8384711f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_22a96513178cba20e5e8c8e830f26dc0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b207010>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_1eb64b8c0e637c201eee61294a9e4093.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_1eb64b8c0e637c201eee61294a9e4093.jpg saved to cache
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b207790>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_132a3015254d69ed862d4067d9e6fae2.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_132a3015254d69ed862d4067d9e6fae2.jpg saved to cache
2026-03-28 18:41:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10a650>
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_bf84db33a06d42da07e5f762f45f4f0f.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_bf84db33a06d42da07e5f762f45f4f0f.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc8ab50>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_b33db9275be40f7346a8c504747034d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_b33db9275be40f7346a8c504747034d8.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b219450>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_a0decb497c2e7b26987a1ff8384711f4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_a0decb497c2e7b26987a1ff8384711f4.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb1890>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_22a96513178cba20e5e8c8e830f26dc0.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_22a96513178cba20e5e8c8e830f26dc0.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_d69baafe761a78b568a334f7c3af28e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_591c223410b0dff560f6f8139ceeeb9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_ef3bfd72e2470caad23a202cc15b3f84.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_754b794ebad8961f743980c4595668d7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_3c809bf79d3ed7bac15626741cf9d421.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_69695ea1263424ba637e5f520a49f8fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_9c24d3cb638c935ccb6121e0d35f8c13.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_a0a5bffaef84ca5a1638db0434b52204.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_203b02a60f356a1cfc2aa1af1f3bc4e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_e3d8ed4f8ee48683c0ae7aecadbc8107.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_32a218003de7e4c53a51d7ac4647ef44.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_b7e3f6a011b8b3ca330cbb803fb88a4f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd31990>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_d69baafe761a78b568a334f7c3af28e8.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_d69baafe761a78b568a334f7c3af28e8.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0295d0>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_591c223410b0dff560f6f8139ceeeb9e.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_591c223410b0dff560f6f8139ceeeb9e.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd31c90>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_ef3bfd72e2470caad23a202cc15b3f84.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_ef3bfd72e2470caad23a202cc15b3f84.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:41:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdce750>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_754b794ebad8961f743980c4595668d7.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_754b794ebad8961f743980c4595668d7.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17b890>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_3c809bf79d3ed7bac15626741cf9d421.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_3c809bf79d3ed7bac15626741cf9d421.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:41:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b22e9d0>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_69695ea1263424ba637e5f520a49f8fe.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_69695ea1263424ba637e5f520a49f8fe.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:41:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b178b10>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_9c24d3cb638c935ccb6121e0d35f8c13.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_9c24d3cb638c935ccb6121e0d35f8c13.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17e310>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_a0a5bffaef84ca5a1638db0434b52204.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_a0a5bffaef84ca5a1638db0434b52204.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b026fd0>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_203b02a60f356a1cfc2aa1af1f3bc4e4.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_203b02a60f356a1cfc2aa1af1f3bc4e4.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdccf10>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_e3d8ed4f8ee48683c0ae7aecadbc8107.jpg') HTTP/1.1" 204 0
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_e3d8ed4f8ee48683c0ae7aecadbc8107.jpg saved to cache
2026-03-28 18:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd83c10>
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:41:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge3%252F1b%252Fe31b433a0746ed6028eea6916169ce15%252Fpa%252FBN44220_32a218003de7e4c53a51d7ac4647ef44.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_32a218003de7e4c53a51d7ac4647ef44.jpg saved to cache
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4
2026-03-28 18:42:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4, skipping ID generation
2026-03-28 18:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with scrape type 1
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 sending to next pipeline
2026-03-28 18:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4, identifier: BN44220
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_3f6f368361c9221558d7fe76e603b820.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with identifier: BN44220
2026-03-28 18:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with identifier: BN44220
2026-03-28 18:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 813336d6-1e43-5e3e-8824-86d8b9a5f8b4 with identifier: BN44220 to the API
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_32a218003de7e4c53a51d7ac4647ef44.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:37:39Z',
 'fuel_type': 'diesel',
 'id': '813336d6-1e43-5e3e-8824-86d8b9a5f8b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN44220',
 'listing': 'auction',
 'location': 'DE, Schweinfurt',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 106566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65469,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_32a218003de7e4c53a51d7ac4647ef44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_bf84db33a06d42da07e5f762f45f4f0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_203b02a60f356a1cfc2aa1af1f3bc4e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48344,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_132a3015254d69ed862d4067d9e6fae2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_d69baafe761a78b568a334f7c3af28e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_b33db9275be40f7346a8c504747034d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1820261,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_754b794ebad8961f743980c4595668d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_591c223410b0dff560f6f8139ceeeb9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_a0decb497c2e7b26987a1ff8384711f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_813336d6-1e43-5e3e-8824-86d8b9a5f8b4/813336d6-1e43-5e3e-8824-86d8b9a5f8b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58779,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge3/1b/e31b433a0746ed6028eea6916169ce15/pa/BN44220_22a96513178cba20e5e8c8e830f26dc0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-31',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Kia Carens 1.7 CRDi Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2016}
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN44220%27 HTTP/1.1" 200 None
2026-03-28 18:42:00 [auto1.de] INFO: Saving data for BN44220: {'created_time': 1774723320.613252, 'last_price_update_time': 1774723320.613264, 'auction_closing_time': 1774885059.0}
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN44220') HTTP/1.1" 204 0
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_8024f64dc80b8ca767345ff812623371.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_e4e3a0f116822bbc41bb25484849e283.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2943d0>
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_b7e3f6a011b8b3ca330cbb803fb88a4f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_b7e3f6a011b8b3ca330cbb803fb88a4f.jpg saved to cache
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1c590>
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_3f6f368361c9221558d7fe76e603b820.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_3f6f368361c9221558d7fe76e603b820.jpg saved to cache
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fde450>
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_8024f64dc80b8ca767345ff812623371.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_8024f64dc80b8ca767345ff812623371.jpg saved to cache
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be93010>
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_e4e3a0f116822bbc41bb25484849e283.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_e4e3a0f116822bbc41bb25484849e283.jpg saved to cache
2026-03-28 18:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_c5a0512b44f88922be791ccbe24117bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_024d5b8a920a72c5ab268ec1e5499801.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2f90d65b6239a8de5b82de91fb2ab7f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_4483251c8352a67d14ef2f133209bdf0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_dd73eb7a68bbcce59d42e1e6d3521487.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a480c1142f95e925870b0fab5fe8c089.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_5896716e5668e8adad1d2838e45f88f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_ed34c53f06c6d3ea39e03168b5c87f7f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb1f9d0>
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_c5a0512b44f88922be791ccbe24117bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_c5a0512b44f88922be791ccbe24117bd.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_2927fd1d78b491efd0ab1c7f71873cfa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_18bafecd2274f03b9fcaf719740abcde.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7e210>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_024d5b8a920a72c5ab268ec1e5499801.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_024d5b8a920a72c5ab268ec1e5499801.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc4f190>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_2f90d65b6239a8de5b82de91fb2ab7f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2f90d65b6239a8de5b82de91fb2ab7f9.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b273210>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_4483251c8352a67d14ef2f133209bdf0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_4483251c8352a67d14ef2f133209bdf0.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc4f510>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_dd73eb7a68bbcce59d42e1e6d3521487.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_dd73eb7a68bbcce59d42e1e6d3521487.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda0110>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_a480c1142f95e925870b0fab5fe8c089.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a480c1142f95e925870b0fab5fe8c089.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb9a10>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_5896716e5668e8adad1d2838e45f88f1.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_5896716e5668e8adad1d2838e45f88f1.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb5f090>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_ed34c53f06c6d3ea39e03168b5c87f7f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_ed34c53f06c6d3ea39e03168b5c87f7f.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068
2026-03-28 18:42:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_02d76d19def3fcd3dce71928edeae5a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c0950>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_2927fd1d78b491efd0ab1c7f71873cfa.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_2927fd1d78b491efd0ab1c7f71873cfa.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b2650>
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fc5%252Ff0c5ef9e01c059cc93d7b82f4344b41b%252Fpa%252FHU15676_18bafecd2274f03b9fcaf719740abcde.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_18bafecd2274f03b9fcaf719740abcde.jpg saved to cache
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9b1eaee-f224-5986-b97d-5ef427717390
2026-03-28 18:42:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9b1eaee-f224-5986-b97d-5ef427717390, skipping ID generation
2026-03-28 18:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9b1eaee-f224-5986-b97d-5ef427717390 with scrape type 1
2026-03-28 18:42:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9b1eaee-f224-5986-b97d-5ef427717390 sending to next pipeline
2026-03-28 18:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9b1eaee-f224-5986-b97d-5ef427717390, identifier: HU15676
2026-03-28 18:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9b1eaee-f224-5986-b97d-5ef427717390 with identifier: HU15676
2026-03-28 18:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9b1eaee-f224-5986-b97d-5ef427717390 with identifier: HU15676
2026-03-28 18:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9b1eaee-f224-5986-b97d-5ef427717390 with identifier: HU15676 to the API
2026-03-28 18:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_18bafecd2274f03b9fcaf719740abcde.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:43:32Z',
 'fuel_type': 'diesel',
 'id': 'a9b1eaee-f224-5986-b97d-5ef427717390',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU15676',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 224416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_18bafecd2274f03b9fcaf719740abcde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_d095116b0ecca58808ae40acb7b8296d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88140,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_5896716e5668e8adad1d2838e45f88f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77351,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_c9d14f6198a778b5c4931ea45b5dca18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72191,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_53a2cf7e7e53efc122bb0335ba082634.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_e4e3a0f116822bbc41bb25484849e283.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_b7e3f6a011b8b3ca330cbb803fb88a4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_e3d8ed4f8ee48683c0ae7aecadbc8107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_3f6f368361c9221558d7fe76e603b820.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9b1eaee-f224-5986-b97d-5ef427717390/a9b1eaee-f224-5986-b97d-5ef427717390_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/c5/f0c5ef9e01c059cc93d7b82f4344b41b/pa/HU15676_a0a5bffaef84ca5a1638db0434b52204.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 R-Design 2WD',
 'transmission': 'automatic',
 'trim': 'R-Design 2WD',
 'year': 2020}
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU15676%27 HTTP/1.1" 200 None
2026-03-28 18:42:02 [auto1.de] INFO: Saving data for HU15676: {'created_time': 1774723322.158177, 'last_price_update_time': 1774723322.158189, 'auction_closing_time': 1774885412.0}
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU15676') HTTP/1.1" 204 0
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_209a6900fcd675c55756ecf68c492caa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_57d6eae59cf5b556f2675d74ef8c471d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2921688e1d3fcbbe36985dcf9413e914.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b0cd0>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_02d76d19def3fcd3dce71928edeae5a1.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_02d76d19def3fcd3dce71928edeae5a1.jpg saved to cache
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a2f45ef1caf46929df96c097da0b2494.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_6e3e9e2599fcab027a9fb72830754182.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_0ca42d221b838ec487be525cc06b1ca6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2223175290cde3f7e7f6ff03637af857.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_fec1c681f82503efa0c034ad5d728953.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_ac97c4fad9b95a6b03100acd0b850119.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be80bd0>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_209a6900fcd675c55756ecf68c492caa.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_209a6900fcd675c55756ecf68c492caa.jpg saved to cache
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beff750>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_57d6eae59cf5b556f2675d74ef8c471d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_57d6eae59cf5b556f2675d74ef8c471d.jpg saved to cache
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_b25169671a97ae1fe0e81c98d72d98da.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_187de1446c11e874885fa2d9b2a9ba48.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16c990>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_2921688e1d3fcbbe36985dcf9413e914.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2921688e1d3fcbbe36985dcf9413e914.jpg saved to cache
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d59210>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_a2f45ef1caf46929df96c097da0b2494.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a2f45ef1caf46929df96c097da0b2494.jpg saved to cache
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:42:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b285950>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_6e3e9e2599fcab027a9fb72830754182.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_6e3e9e2599fcab027a9fb72830754182.jpg saved to cache
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16be90>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_0ca42d221b838ec487be525cc06b1ca6.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_0ca42d221b838ec487be525cc06b1ca6.jpg saved to cache
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068
2026-03-28 18:42:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b286d90>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_2223175290cde3f7e7f6ff03637af857.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2223175290cde3f7e7f6ff03637af857.jpg saved to cache
2026-03-28 18:42:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2453d0>
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_fec1c681f82503efa0c034ad5d728953.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_fec1c681f82503efa0c034ad5d728953.jpg saved to cache
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2868d0>
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_ac97c4fad9b95a6b03100acd0b850119.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_ac97c4fad9b95a6b03100acd0b850119.jpg saved to cache
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_88d16b18a536c5a3070d8c4dd7aa25e4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_58b4fc9ea5c18c03031b2383878ed8a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_93c54740aeff74b66ae5ab62cf5f7fe5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX55373> (referer: https://www.auto1.com/v1/car-details-view/EX55373/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b03d490>
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg62%252F32%252F623204f5695e4fcd4643a41995be68a6%252Fpa%252FLJ25581_b25169671a97ae1fe0e81c98d72d98da.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_b25169671a97ae1fe0e81c98d72d98da.jpg saved to cache
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068
2026-03-28 18:42:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068, skipping ID generation
2026-03-28 18:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with scrape type 1
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 sending to next pipeline
2026-03-28 18:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068, identifier: LJ25581
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d5b850>
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252F4b%252Fb44bfc1dad8bdf1bf854841c365dae6b%252Fpa%252FKJ39198_187de1446c11e874885fa2d9b2a9ba48.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_187de1446c11e874885fa2d9b2a9ba48.jpg saved to cache
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393
2026-03-28 18:42:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3af1b4a5-7f64-5c5c-a306-80508b5fa393, skipping ID generation
2026-03-28 18:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with scrape type 1
2026-03-28 18:42:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3af1b4a5-7f64-5c5c-a306-80508b5fa393 sending to next pipeline
2026-03-28 18:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3af1b4a5-7f64-5c5c-a306-80508b5fa393, identifier: KJ39198
2026-03-28 18:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with identifier: LJ25581
2026-03-28 18:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with identifier: LJ25581
2026-03-28 18:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18115e89-dfc8-5415-a7e2-d3fb6e3e9068 with identifier: LJ25581 to the API
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_b25169671a97ae1fe0e81c98d72d98da.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:52:16Z',
 'fuel_type': 'petrol',
 'id': '18115e89-dfc8-5415-a7e2-d3fb6e3e9068',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ25581',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 160539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_deddc3e096cdca0aeca44c995f9d9613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89343,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_bb5bb04486bbc07ad36cb70d1ea0e3f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_b25169671a97ae1fe0e81c98d72d98da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_0ca42d221b838ec487be525cc06b1ca6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_18115e89-dfc8-5415-a7e2-d3fb6e3e9068/18115e89-dfc8-5415-a7e2-d3fb6e3e9068_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 145115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img62/32/623204f5695e4fcd4643a41995be68a6/pa/LJ25581_ed34c53f06c6d3ea39e03168b5c87f7f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-12-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ25581%27 HTTP/1.1" 200 None
2026-03-28 18:42:03 [auto1.de] INFO: Saving data for LJ25581: {'created_time': 1774723323.787982, 'last_price_update_time': 1774723323.787995, 'auction_closing_time': 1774885936.0}
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ25581') HTTP/1.1" 204 0
2026-03-28 18:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with identifier: KJ39198
2026-03-28 18:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with identifier: KJ39198
2026-03-28 18:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3af1b4a5-7f64-5c5c-a306-80508b5fa393 with identifier: KJ39198 to the API
2026-03-28 18:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_187de1446c11e874885fa2d9b2a9ba48.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 215,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:49Z',
 'fuel_type': 'diesel',
 'id': '3af1b4a5-7f64-5c5c-a306-80508b5fa393',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ39198',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 248634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_44455ea305fc78d68290864fb5b8c7b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_3f38dfdc200435daf17d9a9adc80c543.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_187de1446c11e874885fa2d9b2a9ba48.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_209a6900fcd675c55756ecf68c492caa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3af1b4a5-7f64-5c5c-a306-80508b5fa393/3af1b4a5-7f64-5c5c-a306-80508b5fa393_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 140741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/4b/b44bfc1dad8bdf1bf854841c365dae6b/pa/KJ39198_386c6330d319a976e42ed175d62c24cc.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-09-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 CDI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2008}
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ39198%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [auto1.de] INFO: Saving data for KJ39198: {'created_time': 1774723324.237907, 'last_price_update_time': 1774723324.237921, 'auction_closing_time': 1774885789.0}
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ39198') HTTP/1.1" 204 0
2026-03-28 18:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_48543df16f6a6538a17e8bf165027007.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_a31713609ad1b2926027e90a64a9d161.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_799061b74694bd8a3187ffdbae5d1215.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6d410>
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_88d16b18a536c5a3070d8c4dd7aa25e4.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_88d16b18a536c5a3070d8c4dd7aa25e4.jpg saved to cache
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcfd9d0>
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_58b4fc9ea5c18c03031b2383878ed8a2.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_58b4fc9ea5c18c03031b2383878ed8a2.jpg saved to cache
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b03dc90>
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg98%252F08%252F980858adff0454512fbfd54464e881f9%252Fpa%252FXT85364_93c54740aeff74b66ae5ab62cf5f7fe5.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_93c54740aeff74b66ae5ab62cf5f7fe5.jpg saved to cache
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3
2026-03-28 18:42:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3, skipping ID generation
2026-03-28 18:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with scrape type 1
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 sending to next pipeline
2026-03-28 18:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3, identifier: XT85364
2026-03-28 18:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f7c74a2-f962-54a2-a368-59e4fe976b52 with identifier: EX55373
2026-03-28 18:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7c74a2-f962-54a2-a368-59e4fe976b52 with scrape type 1
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_d3b8773642b2ea53550514f0662622cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_d3b8773642b2ea53550514f0662622cd.jpg not downloaded yet
2026-03-28 18:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with identifier: XT85364
2026-03-28 18:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with identifier: XT85364
2026-03-28 18:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3 with identifier: XT85364 to the API
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_93c54740aeff74b66ae5ab62cf5f7fe5.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:47Z',
 'fuel_type': 'petrol',
 'id': '7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT85364',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 91279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79600,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_f82fe6cab959ba0425a627928dcb465b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2964781,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_1eb64b8c0e637c201eee61294a9e4093.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_93c54740aeff74b66ae5ab62cf5f7fe5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_57d6eae59cf5b556f2675d74ef8c471d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_8618d041dd45b271f6fe5db4f620c7fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_d8d790f311ab686363dcc31d720352a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_dd73eb7a68bbcce59d42e1e6d3521487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_2927fd1d78b491efd0ab1c7f71873cfa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2847864,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_3c809bf79d3ed7bac15626741cf9d421.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3/7494d2d2-ca32-5fa3-9d80-afd7f2c64fc3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2821239,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img98/08/980858adff0454512fbfd54464e881f9/pa/XT85364_69695ea1263424ba637e5f520a49f8fe.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TFSI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT85364%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [auto1.de] INFO: Saving data for XT85364: {'created_time': 1774723324.909824, 'last_price_update_time': 1774723324.909837, 'auction_closing_time': 1774885727.0}
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT85364') HTTP/1.1" 204 0
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_15b4c19bf230bc9e1335182569632e05.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_15b4c19bf230bc9e1335182569632e05.jpg not downloaded yet
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b06bd50>
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_48543df16f6a6538a17e8bf165027007.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_48543df16f6a6538a17e8bf165027007.jpg saved to cache
2026-03-28 18:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbef850>
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_a31713609ad1b2926027e90a64a9d161.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_a31713609ad1b2926027e90a64a9d161.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd83a90>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_799061b74694bd8a3187ffdbae5d1215.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_799061b74694bd8a3187ffdbae5d1215.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_cd56eb0a4dd363817226cf0661d15d62.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_42d12bbc90c7c2a26e84aa390dd914fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_6dadd0bff0932d01a21812c696cdfcce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_459e2bedc5dfa46964385f8e6766ddcf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_459e2bedc5dfa46964385f8e6766ddcf.jpg not downloaded yet
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_b71efc1222edff23a5b60ce4872a5768.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_b71efc1222edff23a5b60ce4872a5768.jpg not downloaded yet
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_040a50bcc0e506ccf7af6f59ef98fd88.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_040a50bcc0e506ccf7af6f59ef98fd88.jpg not downloaded yet
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_60d85883e3ab9855a3237389365d69af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_60d85883e3ab9855a3237389365d69af.jpg not downloaded yet
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_9be61321917f1a2e064197ea6d02d6b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_9be61321917f1a2e064197ea6d02d6b9.jpg not downloaded yet
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_5fe5386657722a1188f95fc638bfa0d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_2a8d11fd562335ad3d224c73f0fa57ed.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_103a9a25d223dba1bd38886b68c2d583.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_103a9a25d223dba1bd38886b68c2d583.jpg not downloaded yet
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_66f5de4a0ee1464cbc547a8a06d8e26f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_66f5de4a0ee1464cbc547a8a06d8e26f.jpg not downloaded yet
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bde5650>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_cd56eb0a4dd363817226cf0661d15d62.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_cd56eb0a4dd363817226cf0661d15d62.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b080590>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_42d12bbc90c7c2a26e84aa390dd914fd.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_42d12bbc90c7c2a26e84aa390dd914fd.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d17a10>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_6dadd0bff0932d01a21812c696cdfcce.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_6dadd0bff0932d01a21812c696cdfcce.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_d9afd1d908afbf36e6d79a66b8fe26a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_d9afd1d908afbf36e6d79a66b8fe26a3.jpg not downloaded yet
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_2436c8ac126b1a035a8bb6aaf4f90f87.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_c8df59fed8fac97fd8875207e196fc8e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_5b4bb31c9d8259be37e81b4f71848804.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b043f90>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_5fe5386657722a1188f95fc638bfa0d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_5fe5386657722a1188f95fc638bfa0d8.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2f8590>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_2a8d11fd562335ad3d224c73f0fa57ed.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_2a8d11fd562335ad3d224c73f0fa57ed.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_e75a907c129c96a45295025dcf802e78.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_15b4c19bf230bc9e1335182569632e05.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_d3b8773642b2ea53550514f0662622cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b5b69514a079202faa384148b50c8f9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_7f72b7297b538924744f09741c19d57b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b040990>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_2436c8ac126b1a035a8bb6aaf4f90f87.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_2436c8ac126b1a035a8bb6aaf4f90f87.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b270c50>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_c8df59fed8fac97fd8875207e196fc8e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_c8df59fed8fac97fd8875207e196fc8e.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_d6d7df1b5db2a4cf9df4922fbd43ae3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_60d85883e3ab9855a3237389365d69af.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_d9afd1d908afbf36e6d79a66b8fe26a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe0c10>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_5b4bb31c9d8259be37e81b4f71848804.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_5b4bb31c9d8259be37e81b4f71848804.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_237a2a8f0ad27eb504bb610e051fa3bd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b106310>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252F78%252F3678ce07fbf3b3cf5a40c7c43526b96e%252Fpa%252FDG41556_e75a907c129c96a45295025dcf802e78.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_e75a907c129c96a45295025dcf802e78.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c319f9a-0510-5652-bedf-1c6f9351daf0
2026-03-28 18:42:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c319f9a-0510-5652-bedf-1c6f9351daf0, skipping ID generation
2026-03-28 18:42:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c319f9a-0510-5652-bedf-1c6f9351daf0 with scrape type 1
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c319f9a-0510-5652-bedf-1c6f9351daf0 sending to next pipeline
2026-03-28 18:42:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c319f9a-0510-5652-bedf-1c6f9351daf0, identifier: DG41556
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdd3e90>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_15b4c19bf230bc9e1335182569632e05.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_15b4c19bf230bc9e1335182569632e05.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2aa210>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_d3b8773642b2ea53550514f0662622cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_d3b8773642b2ea53550514f0662622cd.jpg saved to cache
2026-03-28 18:42:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59cf6810>
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg9c%252F5f%252F9c5fc22912b8844b2981905c30123a86%252Fpa%252FCM42106_b5b69514a079202faa384148b50c8f9a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b5b69514a079202faa384148b50c8f9a.jpg saved to cache
2026-03-28 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d8d503b6-daeb-562a-9db6-a4711381220d
2026-03-28 18:42:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8d503b6-daeb-562a-9db6-a4711381220d, skipping ID generation
2026-03-28 18:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8d503b6-daeb-562a-9db6-a4711381220d with scrape type 1
2026-03-28 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8d503b6-daeb-562a-9db6-a4711381220d sending to next pipeline
2026-03-28 18:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8d503b6-daeb-562a-9db6-a4711381220d, identifier: CM42106
2026-03-28 18:42:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a80d0>
2026-03-28 18:42:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252F14%252Fb914e517cc96c3ffd1913dbf4a5ecab4%252Fpa%252FPR51827_7f72b7297b538924744f09741c19d57b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_7f72b7297b538924744f09741c19d57b.jpg saved to cache
2026-03-28 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2
2026-03-28 18:42:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2, skipping ID generation
2026-03-28 18:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with scrape type 1
2026-03-28 18:42:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 sending to next pipeline
2026-03-28 18:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2, identifier: PR51827
2026-03-28 18:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c319f9a-0510-5652-bedf-1c6f9351daf0 with identifier: DG41556
2026-03-28 18:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c319f9a-0510-5652-bedf-1c6f9351daf0 with identifier: DG41556
2026-03-28 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c319f9a-0510-5652-bedf-1c6f9351daf0 with identifier: DG41556 to the API
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_e75a907c129c96a45295025dcf802e78.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 13,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:29:09Z',
 'fuel_type': 'hybrid',
 'id': '3c319f9a-0510-5652-bedf-1c6f9351daf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG41556',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 129013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_1ce8c6fcedb4467af014310b41615807.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2580754,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a7ae39374774c72857363645697376d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2178374,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_e75a907c129c96a45295025dcf802e78.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_88d16b18a536c5a3070d8c4dd7aa25e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_02d76d19def3fcd3dce71928edeae5a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_9f021cb48361db3dd6645949a798c7f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2131451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a2f45ef1caf46929df96c097da0b2494.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_a480c1142f95e925870b0fab5fe8c089.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_8024f64dc80b8ca767345ff812623371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c319f9a-0510-5652-bedf-1c6f9351daf0/3c319f9a-0510-5652-bedf-1c6f9351daf0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2736299,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img36/78/3678ce07fbf3b3cf5a40c7c43526b96e/pa/DG41556_c5a0512b44f88922be791ccbe24117bd.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2022}
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG41556%27 HTTP/1.1" 200 None
2026-03-28 18:42:06 [auto1.de] INFO: Saving data for DG41556: {'created_time': 1774723326.72066, 'last_price_update_time': 1774723326.720672, 'auction_closing_time': 1774884549.0}
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG41556') HTTP/1.1" 204 0
2026-03-28 18:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8d503b6-daeb-562a-9db6-a4711381220d with identifier: CM42106
2026-03-28 18:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8d503b6-daeb-562a-9db6-a4711381220d with identifier: CM42106
2026-03-28 18:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8d503b6-daeb-562a-9db6-a4711381220d with identifier: CM42106 to the API
2026-03-28 18:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b5b69514a079202faa384148b50c8f9a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:53:49Z',
 'fuel_type': 'petrol',
 'id': 'd8d503b6-daeb-562a-9db6-a4711381220d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM42106',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 97518,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_5fe5386657722a1188f95fc638bfa0d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_6dadd0bff0932d01a21812c696cdfcce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_799061b74694bd8a3187ffdbae5d1215.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64638,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_48543df16f6a6538a17e8bf165027007.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3228265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_ef3bfd72e2470caad23a202cc15b3f84.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b62211bc87216f2c0f73efeac90f5374.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_713d9d3c1456e7a2a66b29f3ac217c3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2986006,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_b5b69514a079202faa384148b50c8f9a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_58b4fc9ea5c18c03031b2383878ed8a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8d503b6-daeb-562a-9db6-a4711381220d/d8d503b6-daeb-562a-9db6-a4711381220d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3321107,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img9c/5f/9c5fc22912b8844b2981905c30123a86/pa/CM42106_ac97c4fad9b95a6b03100acd0b850119.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-05-04',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Club up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Club  BlueMotion Tech',
 'year': 2015}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM42106%27 HTTP/1.1" 200 None
2026-03-28 18:42:07 [auto1.de] INFO: Saving data for CM42106: {'created_time': 1774723327.180161, 'last_price_update_time': 1774723327.180174, 'auction_closing_time': 1774886029.0}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM42106') HTTP/1.1" 204 0
2026-03-28 18:42:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with identifier: PR51827
2026-03-28 18:42:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with identifier: PR51827
2026-03-28 18:42:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b0fdc58-1b9d-5474-967b-307b14b4f1a2 with identifier: PR51827 to the API
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_7f72b7297b538924744f09741c19d57b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:09:02Z',
 'fuel_type': 'petrol',
 'id': '5b0fdc58-1b9d-5474-967b-307b14b4f1a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR51827',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 81693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_2436c8ac126b1a035a8bb6aaf4f90f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_2a8d11fd562335ad3d224c73f0fa57ed.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81794,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_c8df59fed8fac97fd8875207e196fc8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_cd56eb0a4dd363817226cf0661d15d62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80357,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_42d12bbc90c7c2a26e84aa390dd914fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70543,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_a31713609ad1b2926027e90a64a9d161.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_070f22886dc60ee580d4e2d3b781e785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_4f9e209141723d6cfff1f1cc3bddae46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2643197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_e8cd13372eb20bc90da51b069ffc587e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b0fdc58-1b9d-5474-967b-307b14b4f1a2/5b0fdc58-1b9d-5474-967b-307b14b4f1a2_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2450672,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/14/b914e517cc96c3ffd1913dbf4a5ecab4/pa/PR51827_7f72b7297b538924744f09741c19d57b.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-27',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Kia Picanto 1.2 GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2017}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR51827%27 HTTP/1.1" 200 None
2026-03-28 18:42:07 [auto1.de] INFO: Saving data for PR51827: {'created_time': 1774723327.579233, 'last_price_update_time': 1774723327.579248, 'auction_closing_time': 1774883342.0}
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR51827') HTTP/1.1" 204 0
2026-03-28 18:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_b71efc1222edff23a5b60ce4872a5768.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:07 [scrapy.extensions.logstats] INFO: Crawled 515 pages (at 92 pages/min), scraped 714 items (at 56 items/min)
2026-03-28 18:42:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 193MiB
2026-03-28 18:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_459e2bedc5dfa46964385f8e6766ddcf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_3d9ec0aaa47e0ed43da7871862d0ab0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ16493/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU26816> (referer: https://www.auto1.com/v1/car-details-view/KU26816/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26c190>
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_d6d7df1b5db2a4cf9df4922fbd43ae3f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_d6d7df1b5db2a4cf9df4922fbd43ae3f.jpg saved to cache
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1d7190>
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_60d85883e3ab9855a3237389365d69af.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_60d85883e3ab9855a3237389365d69af.jpg saved to cache
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59cf3610>
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_d9afd1d908afbf36e6d79a66b8fe26a3.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_d9afd1d908afbf36e6d79a66b8fe26a3.jpg saved to cache
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0727d0>
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F88%252F19884d1af09f66f0c15bed4baea03d9d%252Fpa%252FAW19440_237a2a8f0ad27eb504bb610e051fa3bd.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_237a2a8f0ad27eb504bb610e051fa3bd.jpg saved to cache
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 776fe438-d8b0-541c-bf45-929e52bcf37e
2026-03-28 18:42:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 776fe438-d8b0-541c-bf45-929e52bcf37e, skipping ID generation
2026-03-28 18:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 776fe438-d8b0-541c-bf45-929e52bcf37e with scrape type 1
2026-03-28 18:42:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 776fe438-d8b0-541c-bf45-929e52bcf37e sending to next pipeline
2026-03-28 18:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 776fe438-d8b0-541c-bf45-929e52bcf37e, identifier: AW19440
2026-03-28 18:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 776fe438-d8b0-541c-bf45-929e52bcf37e with identifier: AW19440
2026-03-28 18:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 776fe438-d8b0-541c-bf45-929e52bcf37e with identifier: AW19440
2026-03-28 18:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 776fe438-d8b0-541c-bf45-929e52bcf37e with identifier: AW19440 to the API
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_237a2a8f0ad27eb504bb610e051fa3bd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:20:50Z',
 'fuel_type': 'petrol',
 'id': '776fe438-d8b0-541c-bf45-929e52bcf37e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW19440',
 'listing': 'auction',
 'location': 'DE, Düsseldorf',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 76816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3372768,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_237a2a8f0ad27eb504bb610e051fa3bd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3246365,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_d6d7df1b5db2a4cf9df4922fbd43ae3f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2921688e1d3fcbbe36985dcf9413e914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3197086,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2223175290cde3f7e7f6ff03637af857.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3325504,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_fec1c681f82503efa0c034ad5d728953.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3232313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_9c24d3cb638c935ccb6121e0d35f8c13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3434106,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_6e3e9e2599fcab027a9fb72830754182.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3163505,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_2f90d65b6239a8de5b82de91fb2ab7f9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3441677,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_4483251c8352a67d14ef2f133209bdf0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_776fe438-d8b0-541c-bf45-929e52bcf37e/776fe438-d8b0-541c-bf45-929e52bcf37e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3215146,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/88/19884d1af09f66f0c15bed4baea03d9d/pa/AW19440_024d5b8a920a72c5ab268ec1e5499801.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2014}
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW19440%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [auto1.de] INFO: Saving data for AW19440: {'created_time': 1774723328.43353, 'last_price_update_time': 1774723328.433541, 'auction_closing_time': 1774884050.0}
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AW19440') HTTP/1.1" 204 0
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d08d0>
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_b71efc1222edff23a5b60ce4872a5768.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_b71efc1222edff23a5b60ce4872a5768.jpg saved to cache
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a7e10>
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_459e2bedc5dfa46964385f8e6766ddcf.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_459e2bedc5dfa46964385f8e6766ddcf.jpg saved to cache
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc5e150>
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_3d9ec0aaa47e0ed43da7871862d0ab0b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_3d9ec0aaa47e0ed43da7871862d0ab0b.jpg saved to cache
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e292d12-7c6c-5333-bf2e-44964d0c2734 with identifier: KU26816
2026-03-28 18:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e292d12-7c6c-5333-bf2e-44964d0c2734 with scrape type 1
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_7d24d74143df81632c2a96cef5e9e6f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_7d24d74143df81632c2a96cef5e9e6f2.jpg not downloaded yet
2026-03-28 18:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_c532e378fb34afa195a2ae36de71c844.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_c532e378fb34afa195a2ae36de71c844.jpg not downloaded yet
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_6d15dee2df62ef841a1e49dd52f1e21e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_6d15dee2df62ef841a1e49dd52f1e21e.jpg not downloaded yet
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_bd0847f9d9a9d204f97c1a11ecd9c9d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_bd0847f9d9a9d204f97c1a11ecd9c9d3.jpg not downloaded yet
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_e7ae6dfa8e4655132b5db1065878d50f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_e7ae6dfa8e4655132b5db1065878d50f.jpg not downloaded yet
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_274fe66c2c82cf9fd92a9aeedcc4b84b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_274fe66c2c82cf9fd92a9aeedcc4b84b.jpg not downloaded yet
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_a2be78663fdb3463fb6c3055d5e67843.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_a2be78663fdb3463fb6c3055d5e67843.jpg not downloaded yet
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_3550157c2b3a6ae5f5df1f8438b4d303.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_3550157c2b3a6ae5f5df1f8438b4d303.jpg not downloaded yet
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_21767d6729314dc0d8c5343e167626fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_21767d6729314dc0d8c5343e167626fb.jpg not downloaded yet
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_90d5292b806a03b13c9f13964aa772b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_90d5292b806a03b13c9f13964aa772b0.jpg not downloaded yet
2026-03-28 18:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_9be61321917f1a2e064197ea6d02d6b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_103a9a25d223dba1bd38886b68c2d583.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_040a50bcc0e506ccf7af6f59ef98fd88.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_66f5de4a0ee1464cbc547a8a06d8e26f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_e4a63d2e2767cf7e5545d7d30ada8981.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_f39528d0845f6108fab1524a101a644b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_a873dac239fc6d14a1143dd7c7d0a06e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b09c810>
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_9be61321917f1a2e064197ea6d02d6b9.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_9be61321917f1a2e064197ea6d02d6b9.jpg saved to cache
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a7950>
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_103a9a25d223dba1bd38886b68c2d583.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_103a9a25d223dba1bd38886b68c2d583.jpg saved to cache
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2acb90>
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_040a50bcc0e506ccf7af6f59ef98fd88.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_040a50bcc0e506ccf7af6f59ef98fd88.jpg saved to cache
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b186110>
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fde%252Fb2de5fb9694062ce00158d8adbc0c7ec%252Fpa%252FEX55373_66f5de4a0ee1464cbc547a8a06d8e26f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_66f5de4a0ee1464cbc547a8a06d8e26f.jpg saved to cache
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f7c74a2-f962-54a2-a368-59e4fe976b52
2026-03-28 18:42:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f7c74a2-f962-54a2-a368-59e4fe976b52, skipping ID generation
2026-03-28 18:42:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f7c74a2-f962-54a2-a368-59e4fe976b52 with scrape type 1
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f7c74a2-f962-54a2-a368-59e4fe976b52 sending to next pipeline
2026-03-28 18:42:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f7c74a2-f962-54a2-a368-59e4fe976b52, identifier: EX55373
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda2b90>
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_e4a63d2e2767cf7e5545d7d30ada8981.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_e4a63d2e2767cf7e5545d7d30ada8981.jpg saved to cache
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb94150>
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_f39528d0845f6108fab1524a101a644b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_f39528d0845f6108fab1524a101a644b.jpg saved to cache
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b187c50>
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_a873dac239fc6d14a1143dd7c7d0a06e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_a873dac239fc6d14a1143dd7c7d0a06e.jpg saved to cache
2026-03-28 18:42:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:42:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f7c74a2-f962-54a2-a368-59e4fe976b52 with identifier: EX55373
2026-03-28 18:42:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f7c74a2-f962-54a2-a368-59e4fe976b52 with identifier: EX55373
2026-03-28 18:42:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f7c74a2-f962-54a2-a368-59e4fe976b52 with identifier: EX55373 to the API
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_66f5de4a0ee1464cbc547a8a06d8e26f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 355,
 'expiration_date': '2026-03-30T15:40:30Z',
 'fuel_type': 'petrol',
 'id': '6f7c74a2-f962-54a2-a368-59e4fe976b52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX55373',
 'listing': 'auction',
 'location': 'DE, Gelsenkirchen',
 'make': 'Audi',
 'model': 'S4',
 'odometer': 59322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_d3b8773642b2ea53550514f0662622cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_15b4c19bf230bc9e1335182569632e05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_459e2bedc5dfa46964385f8e6766ddcf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_b71efc1222edff23a5b60ce4872a5768.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2651301,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_040a50bcc0e506ccf7af6f59ef98fd88.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_60d85883e3ab9855a3237389365d69af.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595453,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_9be61321917f1a2e064197ea6d02d6b9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2662704,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_103a9a25d223dba1bd38886b68c2d583.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2775032,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_66f5de4a0ee1464cbc547a8a06d8e26f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f7c74a2-f962-54a2-a368-59e4fe976b52/6f7c74a2-f962-54a2-a368-59e4fe976b52_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74570,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/de/b2de5fb9694062ce00158d8adbc0c7ec/pa/EX55373_d9afd1d908afbf36e6d79a66b8fe26a3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-10-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi S4 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-28 18:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX55373%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [auto1.de] INFO: Saving data for EX55373: {'created_time': 1774723330.009421, 'last_price_update_time': 1774723330.009435, 'auction_closing_time': 1774885230.0}
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EX55373') HTTP/1.1" 204 0
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC29293/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ74020/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HM10485/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW19107> (referer: https://www.auto1.com/v1/car-details-view/FW19107/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY91981> (referer: https://www.auto1.com/v1/car-details-view/UY91981/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_a235de5a1dddcc8df89878b7c7d8a7db.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_fa27f8f74fe1070cbab7cd282678b2d4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_d687b34c6fafdf067a785fe785c6fd54.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_90d5292b806a03b13c9f13964aa772b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with identifier: FW19107
2026-03-28 18:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with scrape type 1
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0db5af3a-941c-58ea-b5a5-77650bbe63d5
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_16160801d40ce462d49874d95a9bc696.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_16160801d40ce462d49874d95a9bc696.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_6ccfabf5a271325220333fd3f8d13281.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_6ccfabf5a271325220333fd3f8d13281.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_15d1238a87eb7e496123bca6965d20ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_15d1238a87eb7e496123bca6965d20ad.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_f329e40c13e65577db69738061ca54f8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_f329e40c13e65577db69738061ca54f8.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_634321fd0867a8f8518a790d52ca3fb0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_634321fd0867a8f8518a790d52ca3fb0.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_97c7be63361c9adaccb97db578b8ad6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_97c7be63361c9adaccb97db578b8ad6e.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_5e99c0f59bfac1269c743683fe459a23.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_5e99c0f59bfac1269c743683fe459a23.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_123e7061f2bcc3d0ad15cfbc5bff24e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_123e7061f2bcc3d0ad15cfbc5bff24e2.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_6ebc0a07151e6e8995841fe3e6e86a6e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_6ebc0a07151e6e8995841fe3e6e86a6e.jpg already downloaded
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252Fd2%252Fb2d27f690d0ca58f983adf248c3c5114%252Fpa%252FFW19107_f24b97fda12d473a5104d346f5a01743.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_f24b97fda12d473a5104d346f5a01743.jpg already downloaded
2026-03-28 18:42:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0db5af3a-941c-58ea-b5a5-77650bbe63d5, identifier: FW19107
2026-03-28 18:42:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab60df0a-b336-5f49-81c6-b8c042e48330 with identifier: UY91981
2026-03-28 18:42:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab60df0a-b336-5f49-81c6-b8c042e48330 with scrape type 1
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_2d112123cd5223305fe52bc739a53def.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_2d112123cd5223305fe52bc739a53def.jpg not downloaded yet
2026-03-28 18:42:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with identifier: FW19107
2026-03-28 18:42:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with identifier: FW19107
2026-03-28 18:42:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0db5af3a-941c-58ea-b5a5-77650bbe63d5 with identifier: FW19107 to the API
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FW19107>
{'auction_title': '',
 'c_o_2_emission_value': 208,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '3.5L',
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'petrol',
 'id': '0db5af3a-941c-58ea-b5a5-77650bbe63d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW19107',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 343424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_16160801d40ce462d49874d95a9bc696.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_6ccfabf5a271325220333fd3f8d13281.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_15d1238a87eb7e496123bca6965d20ad.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_f329e40c13e65577db69738061ca54f8.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_634321fd0867a8f8518a790d52ca3fb0.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_97c7be63361c9adaccb97db578b8ad6e.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_5e99c0f59bfac1269c743683fe459a23.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_123e7061f2bcc3d0ad15cfbc5bff24e2.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_6ebc0a07151e6e8995841fe3e6e86a6e.jpg',
                'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_f24b97fda12d473a5104d346f5a01743.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_16160801d40ce462d49874d95a9bc696.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_6ccfabf5a271325220333fd3f8d13281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3056066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_15d1238a87eb7e496123bca6965d20ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_f329e40c13e65577db69738061ca54f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69390,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_634321fd0867a8f8518a790d52ca3fb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945490,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_97c7be63361c9adaccb97db578b8ad6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2954334,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_5e99c0f59bfac1269c743683fe459a23.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2898092,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_123e7061f2bcc3d0ad15cfbc5bff24e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2925289,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_6ebc0a07151e6e8995841fe3e6e86a6e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0db5af3a-941c-58ea-b5a5-77650bbe63d5/0db5af3a-941c-58ea-b5a5-77650bbe63d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57812,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/d2/b2d27f690d0ca58f983adf248c3c5114/pa/FW19107_f24b97fda12d473a5104d346f5a01743.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW19107%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [auto1.de] INFO: Saving data for FW19107: {'created_time': 1774723330.782503, 'last_price_update_time': 1774723330.782515, 'auction_closing_time': 1774884330.0}
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW19107') HTTP/1.1" 204 0
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_a2be78663fdb3463fb6c3055d5e67843.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_5d6e775dffda09901d313a266fd8e05d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_5d6e775dffda09901d313a266fd8e05d.jpg not downloaded yet
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_274fe66c2c82cf9fd92a9aeedcc4b84b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_3550157c2b3a6ae5f5df1f8438b4d303.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_f0b2cb31ba60a1ea5379410070ea6205.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_f0b2cb31ba60a1ea5379410070ea6205.jpg not downloaded yet
2026-03-28 18:42:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb40ed0>
2026-03-28 18:42:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_a235de5a1dddcc8df89878b7c7d8a7db.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_a235de5a1dddcc8df89878b7c7d8a7db.jpg saved to cache
2026-03-28 18:42:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:42:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b1190>
2026-03-28 18:42:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_fa27f8f74fe1070cbab7cd282678b2d4.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_fa27f8f74fe1070cbab7cd282678b2d4.jpg saved to cache
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:42:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe1810>
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_d687b34c6fafdf067a785fe785c6fd54.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_d687b34c6fafdf067a785fe785c6fd54.jpg saved to cache
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:42:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc5f810>
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_90d5292b806a03b13c9f13964aa772b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_90d5292b806a03b13c9f13964aa772b0.jpg saved to cache
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_258f419bd1161725240381e6d96620ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_258f419bd1161725240381e6d96620ad.jpg not downloaded yet
2026-03-28 18:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_7d24d74143df81632c2a96cef5e9e6f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05ae50>
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_a2be78663fdb3463fb6c3055d5e67843.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_a2be78663fdb3463fb6c3055d5e67843.jpg saved to cache
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05a790>
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_274fe66c2c82cf9fd92a9aeedcc4b84b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_274fe66c2c82cf9fd92a9aeedcc4b84b.jpg saved to cache
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d38d0>
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_3550157c2b3a6ae5f5df1f8438b4d303.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_3550157c2b3a6ae5f5df1f8438b4d303.jpg saved to cache
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_07b6c073d57fd42d4bb26a25fe58bd09.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_07b6c073d57fd42d4bb26a25fe58bd09.jpg not downloaded yet
2026-03-28 18:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_41305302cd622f277b4dfca95654a9a7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_68b64b082d5f0f2ad25740add106bae4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_68b64b082d5f0f2ad25740add106bae4.jpg not downloaded yet
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7e610>
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_7d24d74143df81632c2a96cef5e9e6f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_7d24d74143df81632c2a96cef5e9e6f2.jpg saved to cache
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_c6564589e2811df5bd270a2be1b370e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_c6564589e2811df5bd270a2be1b370e3.jpg not downloaded yet
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_05b022bc6cf8118a965cf56476334dc1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_05b022bc6cf8118a965cf56476334dc1.jpg not downloaded yet
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_d578f28c187417761152ba38950671b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_d578f28c187417761152ba38950671b7.jpg not downloaded yet
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_ec360b15903634c4405f8afd3e2e37d6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_ec360b15903634c4405f8afd3e2e37d6.jpg not downloaded yet
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02ebd0>
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F8b%252F778b481abab03de641d300d5d0147458%252Fpa%252FFE36611_41305302cd622f277b4dfca95654a9a7.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_41305302cd622f277b4dfca95654a9a7.jpg saved to cache
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898
2026-03-28 18:42:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06a4c7cc-b07f-5e2d-a0d1-17682d363898, skipping ID generation
2026-03-28 18:42:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with scrape type 1
2026-03-28 18:42:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06a4c7cc-b07f-5e2d-a0d1-17682d363898 sending to next pipeline
2026-03-28 18:42:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06a4c7cc-b07f-5e2d-a0d1-17682d363898, identifier: FE36611
2026-03-28 18:42:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with identifier: FE36611
2026-03-28 18:42:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with identifier: FE36611
2026-03-28 18:42:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06a4c7cc-b07f-5e2d-a0d1-17682d363898 with identifier: FE36611 to the API
2026-03-28 18:42:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_41305302cd622f277b4dfca95654a9a7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:35:33Z',
 'fuel_type': 'petrol',
 'id': '06a4c7cc-b07f-5e2d-a0d1-17682d363898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE36611',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 56550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_41305302cd622f277b4dfca95654a9a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_59d74eaca87be157617445e1c02bae4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3302452,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_924b56e2e0c955a1a8ce72fc375d31ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_f39528d0845f6108fab1524a101a644b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3048025,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_a235de5a1dddcc8df89878b7c7d8a7db.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_3cab3d18e7e99a76a54be2fea8987e88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2938225,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_5dfe508d0139dcc56f828faf4493a82f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3026948,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_1ec901e10ad964df66772edd1cd880e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3222332,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_95fbd48daaa6b66726e0e157381f6103.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06a4c7cc-b07f-5e2d-a0d1-17682d363898/06a4c7cc-b07f-5e2d-a0d1-17682d363898_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/8b/778b481abab03de641d300d5d0147458/pa/FE36611_26b6cd9cc28a2d52391e5a20df6ff63e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Club up!',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2016}
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE36611%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [auto1.de] INFO: Saving data for FE36611: {'created_time': 1774723332.14066, 'last_price_update_time': 1774723332.140672, 'auction_closing_time': 1774884933.0}
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE36611') HTTP/1.1" 204 0
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_258f419bd1161725240381e6d96620ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_5d6e775dffda09901d313a266fd8e05d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_f0b2cb31ba60a1ea5379410070ea6205.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ16493> (referer: https://www.auto1.com/v1/car-details-view/KZ16493/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW67018> (referer: https://www.auto1.com/v1/car-details-view/EW67018/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_21767d6729314dc0d8c5343e167626fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_c532e378fb34afa195a2ae36de71c844.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_6d15dee2df62ef841a1e49dd52f1e21e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_e7ae6dfa8e4655132b5db1065878d50f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_bd0847f9d9a9d204f97c1a11ecd9c9d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_2d112123cd5223305fe52bc739a53def.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16bc50>
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_258f419bd1161725240381e6d96620ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_258f419bd1161725240381e6d96620ad.jpg saved to cache
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4befca90>
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_5d6e775dffda09901d313a266fd8e05d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_5d6e775dffda09901d313a266fd8e05d.jpg saved to cache
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b287050>
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_f0b2cb31ba60a1ea5379410070ea6205.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_f0b2cb31ba60a1ea5379410070ea6205.jpg saved to cache
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_ec360b15903634c4405f8afd3e2e37d6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with identifier: KZ16493
2026-03-28 18:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with scrape type 1
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3855e2ae-6a92-5d23-9ec3-f0aebdc25983
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_26bb6df685e89ea7cdf26cfdfe10aef8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_26bb6df685e89ea7cdf26cfdfe10aef8.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_e79c7f8052c9fdc52ad12f885c794695.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_e79c7f8052c9fdc52ad12f885c794695.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_9380444a89c765eb1dd1cab4f811cf5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_9380444a89c765eb1dd1cab4f811cf5c.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_c4bbb19275a2b5e3a669eb8e236b59b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_c4bbb19275a2b5e3a669eb8e236b59b1.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_ae93ec47256fb354570645fb1d833895.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_ae93ec47256fb354570645fb1d833895.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_2cd7d8dad1f1a86c21e169e8c77b81e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_2cd7d8dad1f1a86c21e169e8c77b81e5.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_0290af5d207357528eea07580f89934f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_0290af5d207357528eea07580f89934f.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_8e075c210c1d66f19f49637b52d4a182.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_8e075c210c1d66f19f49637b52d4a182.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_7094ed8b6dfb9550d3f1f7682757bb39.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_7094ed8b6dfb9550d3f1f7682757bb39.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F1d%252F151daa652c9ba2f7030fe1cf3327cb0b%252Fpa%252FKZ16493_d3802955f0cfb727689b5b7975114a98.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_d3802955f0cfb727689b5b7975114a98.jpg already downloaded
2026-03-28 18:42:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983, identifier: KZ16493
2026-03-28 18:42:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb4fc868-1be9-5c31-9102-35d7789cbe76 with identifier: EW67018
2026-03-28 18:42:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb4fc868-1be9-5c31-9102-35d7789cbe76 with scrape type 1
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fb4fc868-1be9-5c31-9102-35d7789cbe76
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_19737a027820aad2e734e46cc3f6db1b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_19737a027820aad2e734e46cc3f6db1b.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_c4482d7b30cd7429e90073125dda8ddb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_c4482d7b30cd7429e90073125dda8ddb.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_6ab492164f69b88a5eaa070be057bdf2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_6ab492164f69b88a5eaa070be057bdf2.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_2466c4590d803ba3154367529758937f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_2466c4590d803ba3154367529758937f.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_3505416bfbfb95d8cc4a21defd4c61a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_3505416bfbfb95d8cc4a21defd4c61a0.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_dc60280462377602561dc7decefc72d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_dc60280462377602561dc7decefc72d9.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_f77bc2bb6eee0ca847a41a41d8b4eaaf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_f77bc2bb6eee0ca847a41a41d8b4eaaf.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_6f73eef58e32eff34386cd6325f9d8b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_6f73eef58e32eff34386cd6325f9d8b7.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_5d5359cfe83e0c368364c042ccebdb28.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_5d5359cfe83e0c368364c042ccebdb28.jpg already downloaded
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252Fa0%252F64a04b13c0f63c0619b6d69e7d18e275%252Fpa%252FEW67018_3232ebbf92bdaed5425fe98595e73649.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_3232ebbf92bdaed5425fe98595e73649.jpg already downloaded
2026-03-28 18:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb4fc868-1be9-5c31-9102-35d7789cbe76, identifier: EW67018
2026-03-28 18:42:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02c990>
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_21767d6729314dc0d8c5343e167626fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_21767d6729314dc0d8c5343e167626fb.jpg saved to cache
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d35d0>
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_c532e378fb34afa195a2ae36de71c844.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_c532e378fb34afa195a2ae36de71c844.jpg saved to cache
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb40b10>
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_6d15dee2df62ef841a1e49dd52f1e21e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_6d15dee2df62ef841a1e49dd52f1e21e.jpg saved to cache
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b219b90>
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_e7ae6dfa8e4655132b5db1065878d50f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_e7ae6dfa8e4655132b5db1065878d50f.jpg saved to cache
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1f8b10>
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252Fc9%252F94c94a85be61095c072c08fa4df50f7b%252Fpa%252FKU26816_bd0847f9d9a9d204f97c1a11ecd9c9d3.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_bd0847f9d9a9d204f97c1a11ecd9c9d3.jpg saved to cache
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e292d12-7c6c-5333-bf2e-44964d0c2734
2026-03-28 18:42:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e292d12-7c6c-5333-bf2e-44964d0c2734, skipping ID generation
2026-03-28 18:42:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e292d12-7c6c-5333-bf2e-44964d0c2734 with scrape type 1
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e292d12-7c6c-5333-bf2e-44964d0c2734 sending to next pipeline
2026-03-28 18:42:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e292d12-7c6c-5333-bf2e-44964d0c2734, identifier: KU26816
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2d0050>
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_2d112123cd5223305fe52bc739a53def.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_2d112123cd5223305fe52bc739a53def.jpg saved to cache
2026-03-28 18:42:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_07b6c073d57fd42d4bb26a25fe58bd09.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with identifier: KZ16493
2026-03-28 18:42:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with identifier: KZ16493
2026-03-28 18:42:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3855e2ae-6a92-5d23-9ec3-f0aebdc25983 with identifier: KZ16493 to the API
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KZ16493>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:46:09Z',
 'fuel_type': 'petrol',
 'id': '3855e2ae-6a92-5d23-9ec3-f0aebdc25983',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ16493',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 40177,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_26bb6df685e89ea7cdf26cfdfe10aef8.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_e79c7f8052c9fdc52ad12f885c794695.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_9380444a89c765eb1dd1cab4f811cf5c.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_c4bbb19275a2b5e3a669eb8e236b59b1.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_ae93ec47256fb354570645fb1d833895.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_2cd7d8dad1f1a86c21e169e8c77b81e5.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_0290af5d207357528eea07580f89934f.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_8e075c210c1d66f19f49637b52d4a182.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_7094ed8b6dfb9550d3f1f7682757bb39.jpg',
                'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_d3802955f0cfb727689b5b7975114a98.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74624,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_26bb6df685e89ea7cdf26cfdfe10aef8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_e79c7f8052c9fdc52ad12f885c794695.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_9380444a89c765eb1dd1cab4f811cf5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54623,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_c4bbb19275a2b5e3a669eb8e236b59b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66756,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_ae93ec47256fb354570645fb1d833895.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_2cd7d8dad1f1a86c21e169e8c77b81e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58033,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_0290af5d207357528eea07580f89934f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_8e075c210c1d66f19f49637b52d4a182.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78714,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_7094ed8b6dfb9550d3f1f7682757bb39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3855e2ae-6a92-5d23-9ec3-f0aebdc25983/3855e2ae-6a92-5d23-9ec3-f0aebdc25983_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/1d/151daa652c9ba2f7030fe1cf3327cb0b/pa/KZ16493_d3802955f0cfb727689b5b7975114a98.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-05-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ16493%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Saving data for KZ16493: {'created_time': 1774723334.11704, 'last_price_update_time': 1774723334.117051, 'auction_closing_time': 1774885569.0}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ16493') HTTP/1.1" 204 0
2026-03-28 18:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb4fc868-1be9-5c31-9102-35d7789cbe76 with identifier: EW67018
2026-03-28 18:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb4fc868-1be9-5c31-9102-35d7789cbe76 with identifier: EW67018
2026-03-28 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb4fc868-1be9-5c31-9102-35d7789cbe76 with identifier: EW67018 to the API
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EW67018>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:49:09Z',
 'fuel_type': 'petrol',
 'id': 'fb4fc868-1be9-5c31-9102-35d7789cbe76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW67018',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 101793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_19737a027820aad2e734e46cc3f6db1b.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_c4482d7b30cd7429e90073125dda8ddb.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_6ab492164f69b88a5eaa070be057bdf2.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_2466c4590d803ba3154367529758937f.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_3505416bfbfb95d8cc4a21defd4c61a0.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_dc60280462377602561dc7decefc72d9.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_f77bc2bb6eee0ca847a41a41d8b4eaaf.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_6f73eef58e32eff34386cd6325f9d8b7.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_5d5359cfe83e0c368364c042ccebdb28.jpg',
                'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_3232ebbf92bdaed5425fe98595e73649.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_19737a027820aad2e734e46cc3f6db1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3132495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_c4482d7b30cd7429e90073125dda8ddb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73801,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_6ab492164f69b88a5eaa070be057bdf2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68969,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_2466c4590d803ba3154367529758937f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3131315,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_3505416bfbfb95d8cc4a21defd4c61a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3211906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_dc60280462377602561dc7decefc72d9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66865,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_f77bc2bb6eee0ca847a41a41d8b4eaaf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_6f73eef58e32eff34386cd6325f9d8b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_5d5359cfe83e0c368364c042ccebdb28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb4fc868-1be9-5c31-9102-35d7789cbe76/fb4fc868-1be9-5c31-9102-35d7789cbe76_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/a0/64a04b13c0f63c0619b6d69e7d18e275/pa/EW67018_3232ebbf92bdaed5425fe98595e73649.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW67018%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Saving data for EW67018: {'created_time': 1774723334.498843, 'last_price_update_time': 1774723334.498855, 'auction_closing_time': 1774885749.0}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW67018') HTTP/1.1" 204 0
2026-03-28 18:42:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e292d12-7c6c-5333-bf2e-44964d0c2734 with identifier: KU26816
2026-03-28 18:42:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e292d12-7c6c-5333-bf2e-44964d0c2734 with identifier: KU26816
2026-03-28 18:42:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e292d12-7c6c-5333-bf2e-44964d0c2734 with identifier: KU26816 to the API
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_bd0847f9d9a9d204f97c1a11ecd9c9d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:22:26Z',
 'fuel_type': 'petrol',
 'id': '3e292d12-7c6c-5333-bf2e-44964d0c2734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU26816',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 102679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_7d24d74143df81632c2a96cef5e9e6f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3051218,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_c532e378fb34afa195a2ae36de71c844.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974839,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_6d15dee2df62ef841a1e49dd52f1e21e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3017592,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_bd0847f9d9a9d204f97c1a11ecd9c9d3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3089366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_e7ae6dfa8e4655132b5db1065878d50f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_274fe66c2c82cf9fd92a9aeedcc4b84b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60425,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_a2be78663fdb3463fb6c3055d5e67843.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_3550157c2b3a6ae5f5df1f8438b4d303.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2916698,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_21767d6729314dc0d8c5343e167626fb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e292d12-7c6c-5333-bf2e-44964d0c2734/3e292d12-7c6c-5333-bf2e-44964d0c2734_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3072396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img94/c9/94c94a85be61095c072c08fa4df50f7b/pa/KU26816_90d5292b806a03b13c9f13964aa772b0.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-11-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Edition 2020 AMG Line',
 'transmission': 'manual',
 'trim': 'Edition 2020 AMG Line',
 'year': 2020}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU26816%27 HTTP/1.1" 200 None
2026-03-28 18:42:14 [auto1.de] INFO: Saving data for KU26816: {'created_time': 1774723334.898942, 'last_price_update_time': 1774723334.898952, 'auction_closing_time': 1774884146.0}
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU26816') HTTP/1.1" 204 0
2026-03-28 18:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ74020> (referer: https://www.auto1.com/v1/car-details-view/GZ74020/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HM10485> (referer: https://www.auto1.com/v1/car-details-view/HM10485/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC29293> (referer: https://www.auto1.com/v1/car-details-view/KC29293/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b235550>
2026-03-28 18:42:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_ec360b15903634c4405f8afd3e2e37d6.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_ec360b15903634c4405f8afd3e2e37d6.jpg saved to cache
2026-03-28 18:42:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdcf9d0>
2026-03-28 18:42:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_07b6c073d57fd42d4bb26a25fe58bd09.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_07b6c073d57fd42d4bb26a25fe58bd09.jpg saved to cache
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a468438a-4dec-5f5a-892f-8210f599ecc3 with identifier: GZ74020
2026-03-28 18:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a468438a-4dec-5f5a-892f-8210f599ecc3 with scrape type 1
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a468438a-4dec-5f5a-892f-8210f599ecc3
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_73f1849eba0db7e9a6e99c6c3790fa3d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_73f1849eba0db7e9a6e99c6c3790fa3d.jpg not downloaded yet
2026-03-28 18:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7641d199-36f9-5945-9967-f210baa6f265 with identifier: HM10485
2026-03-28 18:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7641d199-36f9-5945-9967-f210baa6f265 with scrape type 1
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7641d199-36f9-5945-9967-f210baa6f265
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fe5%252Ff2e5f1915a8aeac5f779809d7f5f1d45%252Fpa%252FHM10485_58fb0f389b375580cb71fa207e3d9536.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_58fb0f389b375580cb71fa207e3d9536.jpg already downloaded
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fe5%252Ff2e5f1915a8aeac5f779809d7f5f1d45%252Fpa%252FHM10485_485fc7799feeedc432f1677f2881ed18.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_485fc7799feeedc432f1677f2881ed18.jpg already downloaded
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fe5%252Ff2e5f1915a8aeac5f779809d7f5f1d45%252Fpa%252FHM10485_e8fe35d55e6ae1f1743a47a4184e5f08.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_e8fe35d55e6ae1f1743a47a4184e5f08.jpg already downloaded
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fe5%252Ff2e5f1915a8aeac5f779809d7f5f1d45%252Fpa%252FHM10485_76708dc6b007111a59a798ccaafa5273.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_76708dc6b007111a59a798ccaafa5273.jpg already downloaded
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252Fe5%252Ff2e5f1915a8aeac5f779809d7f5f1d45%252Fpa%252FHM10485_c99c62ca9142cc4d77eb0dc44b9199d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_c99c62ca9142cc4d77eb0dc44b9199d9.jpg already downloaded
2026-03-28 18:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7641d199-36f9-5945-9967-f210baa6f265, identifier: HM10485
2026-03-28 18:42:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70083eab-e53b-54ac-8b5d-27b9b357742d with identifier: KC29293
2026-03-28 18:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70083eab-e53b-54ac-8b5d-27b9b357742d with scrape type 1
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 70083eab-e53b-54ac-8b5d-27b9b357742d
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_bb1f34f49bb1ae7465ef95308b8a3dfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_bb1f34f49bb1ae7465ef95308b8a3dfb.jpg not downloaded yet
2026-03-28 18:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7641d199-36f9-5945-9967-f210baa6f265 with identifier: HM10485
2026-03-28 18:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7641d199-36f9-5945-9967-f210baa6f265 with identifier: HM10485
2026-03-28 18:42:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7641d199-36f9-5945-9967-f210baa6f265 with identifier: HM10485 to the API
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HM10485>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:54:18Z',
 'fuel_type': 'diesel',
 'id': '7641d199-36f9-5945-9967-f210baa6f265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM10485',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 359248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_58fb0f389b375580cb71fa207e3d9536.jpg',
                'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_485fc7799feeedc432f1677f2881ed18.jpg',
                'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_e8fe35d55e6ae1f1743a47a4184e5f08.jpg',
                'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_76708dc6b007111a59a798ccaafa5273.jpg',
                'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_c99c62ca9142cc4d77eb0dc44b9199d9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7641d199-36f9-5945-9967-f210baa6f265/7641d199-36f9-5945-9967-f210baa6f265_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89730,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_58fb0f389b375580cb71fa207e3d9536.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7641d199-36f9-5945-9967-f210baa6f265/7641d199-36f9-5945-9967-f210baa6f265_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_485fc7799feeedc432f1677f2881ed18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7641d199-36f9-5945-9967-f210baa6f265/7641d199-36f9-5945-9967-f210baa6f265_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_e8fe35d55e6ae1f1743a47a4184e5f08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7641d199-36f9-5945-9967-f210baa6f265/7641d199-36f9-5945-9967-f210baa6f265_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_76708dc6b007111a59a798ccaafa5273.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7641d199-36f9-5945-9967-f210baa6f265/7641d199-36f9-5945-9967-f210baa6f265_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/e5/f2e5f1915a8aeac5f779809d7f5f1d45/pa/HM10485_c99c62ca9142cc4d77eb0dc44b9199d9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-07-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM10485%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [auto1.de] INFO: Saving data for HM10485: {'created_time': 1774723335.609718, 'last_price_update_time': 1774723335.609731, 'auction_closing_time': 1774886058.0}
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM10485') HTTP/1.1" 204 0
2026-03-28 18:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_74cab51f49b44e71682fb31b334b6709.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_2ca277abf2ad0384a4c6fc967330f1f6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_2ca277abf2ad0384a4c6fc967330f1f6.jpg not downloaded yet
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_54121368e64302b4102975bd63f6692f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_54121368e64302b4102975bd63f6692f.jpg not downloaded yet
2026-03-28 18:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_c51fb98cc15299ecc2f0ee98bae9dfd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_38236dbb110c083c02234db6dccf0b0b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_38236dbb110c083c02234db6dccf0b0b.jpg not downloaded yet
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_ca3462641e5ca1f220f0fff5bc71d78e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_ca3462641e5ca1f220f0fff5bc71d78e.jpg not downloaded yet
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_1747080a0d35301a2168f555fc213d05.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_1747080a0d35301a2168f555fc213d05.jpg not downloaded yet
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_382f5d6463027c03585c9b2d3f1109ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_382f5d6463027c03585c9b2d3f1109ce.jpg not downloaded yet
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_35fc460d6dfec40554a78c73a6243c2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_35fc460d6dfec40554a78c73a6243c2e.jpg not downloaded yet
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_bce08ed84ecf3ff763c97471de5689ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_bce08ed84ecf3ff763c97471de5689ad.jpg not downloaded yet
2026-03-28 18:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_68b64b082d5f0f2ad25740add106bae4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2f82d0>
2026-03-28 18:42:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_74cab51f49b44e71682fb31b334b6709.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_74cab51f49b44e71682fb31b334b6709.jpg saved to cache
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_c6564589e2811df5bd270a2be1b370e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_bb1f34f49bb1ae7465ef95308b8a3dfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_73f1849eba0db7e9a6e99c6c3790fa3d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc305d0>
2026-03-28 18:42:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2b%252F7b%252F2b7beac9c11dd9e86d7da0f3b1c106e7%252Fpa%252FRX22328_c51fb98cc15299ecc2f0ee98bae9dfd6.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_c51fb98cc15299ecc2f0ee98bae9dfd6.jpg saved to cache
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43b09e42-afec-5653-a101-b286949b5a95
2026-03-28 18:42:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43b09e42-afec-5653-a101-b286949b5a95, skipping ID generation
2026-03-28 18:42:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43b09e42-afec-5653-a101-b286949b5a95 with scrape type 1
2026-03-28 18:42:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43b09e42-afec-5653-a101-b286949b5a95 sending to next pipeline
2026-03-28 18:42:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43b09e42-afec-5653-a101-b286949b5a95, identifier: RX22328
2026-03-28 18:42:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_05b022bc6cf8118a965cf56476334dc1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43b09e42-afec-5653-a101-b286949b5a95 with identifier: RX22328
2026-03-28 18:42:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43b09e42-afec-5653-a101-b286949b5a95 with identifier: RX22328
2026-03-28 18:42:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43b09e42-afec-5653-a101-b286949b5a95 with identifier: RX22328 to the API
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_c51fb98cc15299ecc2f0ee98bae9dfd6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 233,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:37:42Z',
 'fuel_type': 'diesel',
 'id': '43b09e42-afec-5653-a101-b286949b5a95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX22328',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 332893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_bca50f98869e38f2fb4448e978797186.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2926292,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_8abd3b3a8a896b2cb1897e1e62d7d83c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2449315,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_2b8fb1376bc4831a87bb0e7c3807d76a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2454049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_049fb4d93f941829af082ee4f87fb3c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53789,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_de5934168f8d72696dd1de6a010dfec8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_ede58bf3d15373fb70022f56885f5690.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_74cab51f49b44e71682fb31b334b6709.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_192418e3a3c4ce27725f1301c8edc1e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_c51fb98cc15299ecc2f0ee98bae9dfd6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_43b09e42-afec-5653-a101-b286949b5a95/43b09e42-afec-5653-a101-b286949b5a95_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2b/7b/2b7beac9c11dd9e86d7da0f3b1c106e7/pa/RX22328_6ffb8d674c82de85dfce1f2bd4bf0109.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 313 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX22328%27 HTTP/1.1" 200 None
2026-03-28 18:42:16 [auto1.de] INFO: Saving data for RX22328: {'created_time': 1774723336.366532, 'last_price_update_time': 1774723336.366545, 'auction_closing_time': 1774885062.0}
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX22328') HTTP/1.1" 204 0
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_382f5d6463027c03585c9b2d3f1109ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_d578f28c187417761152ba38950671b7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_bce08ed84ecf3ff763c97471de5689ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb611d0>
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_68b64b082d5f0f2ad25740add106bae4.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_68b64b082d5f0f2ad25740add106bae4.jpg saved to cache
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b03f9d0>
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_c6564589e2811df5bd270a2be1b370e3.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_c6564589e2811df5bd270a2be1b370e3.jpg saved to cache
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beb1e10>
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_bb1f34f49bb1ae7465ef95308b8a3dfb.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_bb1f34f49bb1ae7465ef95308b8a3dfb.jpg saved to cache
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70083eab-e53b-54ac-8b5d-27b9b357742d
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7c210>
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_73f1849eba0db7e9a6e99c6c3790fa3d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_73f1849eba0db7e9a6e99c6c3790fa3d.jpg saved to cache
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a468438a-4dec-5f5a-892f-8210f599ecc3
2026-03-28 18:42:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b03f9d0>
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_05b022bc6cf8118a965cf56476334dc1.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_05b022bc6cf8118a965cf56476334dc1.jpg saved to cache
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_54d75b3dcba4b55f2e35faf7682d8b4a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HL66974> (referer: https://www.auto1.com/v1/car-details-view/HL66974/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AL30364> (referer: https://www.auto1.com/v1/car-details-view/AL30364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN86096> (referer: https://www.auto1.com/v1/car-details-view/DN86096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZA82087/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KT60539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1d6950>
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_382f5d6463027c03585c9b2d3f1109ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_382f5d6463027c03585c9b2d3f1109ce.jpg saved to cache
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70083eab-e53b-54ac-8b5d-27b9b357742d
2026-03-28 18:42:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b19e050>
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252Fef%252F74ef781c89412a7f3e9135bb9631494f%252Fpa%252FUY91981_d578f28c187417761152ba38950671b7.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_d578f28c187417761152ba38950671b7.jpg saved to cache
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab60df0a-b336-5f49-81c6-b8c042e48330
2026-03-28 18:42:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab60df0a-b336-5f49-81c6-b8c042e48330, skipping ID generation
2026-03-28 18:42:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab60df0a-b336-5f49-81c6-b8c042e48330 with scrape type 1
2026-03-28 18:42:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab60df0a-b336-5f49-81c6-b8c042e48330 sending to next pipeline
2026-03-28 18:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab60df0a-b336-5f49-81c6-b8c042e48330, identifier: UY91981
2026-03-28 18:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5ab1b990>
2026-03-28 18:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_bce08ed84ecf3ff763c97471de5689ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_bce08ed84ecf3ff763c97471de5689ad.jpg saved to cache
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70083eab-e53b-54ac-8b5d-27b9b357742d
2026-03-28 18:42:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab60df0a-b336-5f49-81c6-b8c042e48330 with identifier: UY91981
2026-03-28 18:42:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab60df0a-b336-5f49-81c6-b8c042e48330 with identifier: UY91981
2026-03-28 18:42:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab60df0a-b336-5f49-81c6-b8c042e48330 with identifier: UY91981 to the API
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_d578f28c187417761152ba38950671b7.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:13:24Z',
 'fuel_type': 'diesel',
 'id': 'ab60df0a-b336-5f49-81c6-b8c042e48330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY91981',
 'listing': 'auction',
 'location': 'DE, Chemnitz',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 109267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_2d112123cd5223305fe52bc739a53def.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_5d6e775dffda09901d313a266fd8e05d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_f0b2cb31ba60a1ea5379410070ea6205.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_258f419bd1161725240381e6d96620ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_07b6c073d57fd42d4bb26a25fe58bd09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2331417,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_68b64b082d5f0f2ad25740add106bae4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410249,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_c6564589e2811df5bd270a2be1b370e3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2585555,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_05b022bc6cf8118a965cf56476334dc1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2836251,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_d578f28c187417761152ba38950671b7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab60df0a-b336-5f49-81c6-b8c042e48330/ab60df0a-b336-5f49-81c6-b8c042e48330_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71119,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/ef/74ef781c89412a7f3e9135bb9631494f/pa/UY91981_ec360b15903634c4405f8afd3e2e37d6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.5 Blue-HDi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2019}
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY91981%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [auto1.de] INFO: Saving data for UY91981: {'created_time': 1774723337.487762, 'last_price_update_time': 1774723337.487774, 'auction_closing_time': 1774883604.0}
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY91981') HTTP/1.1" 204 0
2026-03-28 18:42:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b58be4090>
2026-03-28 18:42:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fd1%252F59d1b949d39a14251da45c6512839a57%252Fpa%252FUP55636_54d75b3dcba4b55f2e35faf7682d8b4a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_54d75b3dcba4b55f2e35faf7682d8b4a.jpg saved to cache
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 96a9fc37-8973-53f1-b9d5-0689115e690a
2026-03-28 18:42:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 96a9fc37-8973-53f1-b9d5-0689115e690a, skipping ID generation
2026-03-28 18:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96a9fc37-8973-53f1-b9d5-0689115e690a with scrape type 1
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 96a9fc37-8973-53f1-b9d5-0689115e690a sending to next pipeline
2026-03-28 18:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96a9fc37-8973-53f1-b9d5-0689115e690a, identifier: UP55636
2026-03-28 18:42:17 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4f7648-08b9-5a3a-99f0-397a66b393f3 with identifier: HL66974
2026-03-28 18:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4f7648-08b9-5a3a-99f0-397a66b393f3 with scrape type 1
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf4f7648-08b9-5a3a-99f0-397a66b393f3
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_715e294c0841ebce3a804f71fd696795.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_715e294c0841ebce3a804f71fd696795.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_768f379c84fd8c7d555aa66fd58a6dd1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_768f379c84fd8c7d555aa66fd58a6dd1.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_69e08bf06dafe799ae0c67ab85fc8b4d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_69e08bf06dafe799ae0c67ab85fc8b4d.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_ab238af98939798970a6dc7b65eafa14.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_ab238af98939798970a6dc7b65eafa14.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_c37949d4a8ef35fb76d5346546055ad3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_c37949d4a8ef35fb76d5346546055ad3.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_02e69fc0b6aa5cf3ae84e06b87b6b848.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_02e69fc0b6aa5cf3ae84e06b87b6b848.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_368eddc6941c64770efb7ce39b80432b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_368eddc6941c64770efb7ce39b80432b.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_aa21a1f789c5d99430f9a70758e76193.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_aa21a1f789c5d99430f9a70758e76193.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_b75655e20d63b8a3128376802c66c5ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_b75655e20d63b8a3128376802c66c5ad.jpg already downloaded
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Fbb%252F5abb4bfccfcb5849ddecac7cbbedcf11%252Fpa%252FHL66974_ed1ec2ac4031cdfb6be7761723ea30ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_ed1ec2ac4031cdfb6be7761723ea30ec.jpg already downloaded
2026-03-28 18:42:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf4f7648-08b9-5a3a-99f0-397a66b393f3, identifier: HL66974
2026-03-28 18:42:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4000ab82-0858-5b4b-ae7e-708aef28a00e with identifier: AL30364
2026-03-28 18:42:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4000ab82-0858-5b4b-ae7e-708aef28a00e with scrape type 1
2026-03-28 18:42:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_6871e47d55e8cd3e5f740ac132f449fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_6871e47d55e8cd3e5f740ac132f449fa.jpg not downloaded yet
2026-03-28 18:42:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004ed81a-173c-54ba-adc0-8d6e5b6a693e with identifier: DN86096
2026-03-28 18:42:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004ed81a-173c-54ba-adc0-8d6e5b6a693e with scrape type 1
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 004ed81a-173c-54ba-adc0-8d6e5b6a693e
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_c68ca669d49e09c0cbc115228908ca75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_c68ca669d49e09c0cbc115228908ca75.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_482a01d9307d668d7820f7b9a133f57f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_482a01d9307d668d7820f7b9a133f57f.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_53434a6695a44e2ae3169e8433d4ad0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_53434a6695a44e2ae3169e8433d4ad0c.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_31e238009626209cb139c60468749b5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_31e238009626209cb139c60468749b5c.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_61326123251f368e0011c27bb85a1f12.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_61326123251f368e0011c27bb85a1f12.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_1ea5e7687fdd5c8f24d1ae90d2a4d56c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_1ea5e7687fdd5c8f24d1ae90d2a4d56c.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_442296ac43577190f7e13ce10ffa179c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_442296ac43577190f7e13ce10ffa179c.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_05b530c2b5e0b8d9bdb650601b829a26.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_05b530c2b5e0b8d9bdb650601b829a26.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_689e8d7c546ea9f904a2198f679e4375.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_689e8d7c546ea9f904a2198f679e4375.jpg already downloaded
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F8c%252F758c21425a10be6727081366caceae1d%252Fpa%252FDN86096_e02989dca907c2f91e0c5f68db91dcd9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_e02989dca907c2f91e0c5f68db91dcd9.jpg already downloaded
2026-03-28 18:42:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 004ed81a-173c-54ba-adc0-8d6e5b6a693e, identifier: DN86096
2026-03-28 18:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96a9fc37-8973-53f1-b9d5-0689115e690a with identifier: UP55636
2026-03-28 18:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96a9fc37-8973-53f1-b9d5-0689115e690a with identifier: UP55636
2026-03-28 18:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96a9fc37-8973-53f1-b9d5-0689115e690a with identifier: UP55636 to the API
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_54d75b3dcba4b55f2e35faf7682d8b4a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:14:05Z',
 'fuel_type': 'petrol',
 'id': '96a9fc37-8973-53f1-b9d5-0689115e690a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP55636',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 61639,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3052518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_54d75b3dcba4b55f2e35faf7682d8b4a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3087451,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_d687b34c6fafdf067a785fe785c6fd54.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974573,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_fa27f8f74fe1070cbab7cd282678b2d4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_a873dac239fc6d14a1143dd7c7d0a06e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_e4a63d2e2767cf7e5545d7d30ada8981.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76646,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_3d9ec0aaa47e0ed43da7871862d0ab0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_5b4bb31c9d8259be37e81b4f71848804.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_a94cc80c5576b76bc1cd84ddf14ffa8f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_e6cc0478738fc30f102870d431385664.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_96a9fc37-8973-53f1-b9d5-0689115e690a/96a9fc37-8973-53f1-b9d5-0689115e690a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2733275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img59/d1/59d1b949d39a14251da45c6512839a57/pa/UP55636_9a0e10b9549d0c5e39a174d371a1369e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-10-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Edition 7 2WD',
 'transmission': 'manual',
 'trim': 'Edition 7 2WD',
 'year': 2019}
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP55636%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Saving data for UP55636: {'created_time': 1774723338.638544, 'last_price_update_time': 1774723338.638556, 'auction_closing_time': 1774883645.0}
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP55636') HTTP/1.1" 204 0
2026-03-28 18:42:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf4f7648-08b9-5a3a-99f0-397a66b393f3 with identifier: HL66974
2026-03-28 18:42:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf4f7648-08b9-5a3a-99f0-397a66b393f3 with identifier: HL66974
2026-03-28 18:42:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf4f7648-08b9-5a3a-99f0-397a66b393f3 with identifier: HL66974 to the API
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HL66974>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:40Z',
 'fuel_type': 'diesel',
 'id': 'cf4f7648-08b9-5a3a-99f0-397a66b393f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL66974',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 139380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_715e294c0841ebce3a804f71fd696795.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_768f379c84fd8c7d555aa66fd58a6dd1.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_69e08bf06dafe799ae0c67ab85fc8b4d.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_ab238af98939798970a6dc7b65eafa14.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_c37949d4a8ef35fb76d5346546055ad3.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_02e69fc0b6aa5cf3ae84e06b87b6b848.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_368eddc6941c64770efb7ce39b80432b.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_aa21a1f789c5d99430f9a70758e76193.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_b75655e20d63b8a3128376802c66c5ad.jpg',
                'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_ed1ec2ac4031cdfb6be7761723ea30ec.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927532,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_715e294c0841ebce3a804f71fd696795.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_768f379c84fd8c7d555aa66fd58a6dd1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2980598,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_69e08bf06dafe799ae0c67ab85fc8b4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56366,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_ab238af98939798970a6dc7b65eafa14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_c37949d4a8ef35fb76d5346546055ad3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2932153,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_02e69fc0b6aa5cf3ae84e06b87b6b848.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_368eddc6941c64770efb7ce39b80432b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2898918,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_aa21a1f789c5d99430f9a70758e76193.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2882503,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_b75655e20d63b8a3128376802c66c5ad.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf4f7648-08b9-5a3a-99f0-397a66b393f3/cf4f7648-08b9-5a3a-99f0-397a66b393f3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3372390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/bb/5abb4bfccfcb5849ddecac7cbbedcf11/pa/HL66974_ed1ec2ac4031cdfb6be7761723ea30ec.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-07-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2016}
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL66974%27 HTTP/1.1" 200 None
2026-03-28 18:42:18 [auto1.de] INFO: Saving data for HL66974: {'created_time': 1774723338.994568, 'last_price_update_time': 1774723338.99458, 'auction_closing_time': 1774884220.0}
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL66974') HTTP/1.1" 204 0
2026-03-28 18:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 004ed81a-173c-54ba-adc0-8d6e5b6a693e with identifier: DN86096
2026-03-28 18:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 004ed81a-173c-54ba-adc0-8d6e5b6a693e with identifier: DN86096
2026-03-28 18:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 004ed81a-173c-54ba-adc0-8d6e5b6a693e with identifier: DN86096 to the API
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DN86096>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:26:53Z',
 'fuel_type': 'diesel',
 'id': '004ed81a-173c-54ba-adc0-8d6e5b6a693e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN86096',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 103249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_c68ca669d49e09c0cbc115228908ca75.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_482a01d9307d668d7820f7b9a133f57f.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_53434a6695a44e2ae3169e8433d4ad0c.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_31e238009626209cb139c60468749b5c.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_61326123251f368e0011c27bb85a1f12.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_1ea5e7687fdd5c8f24d1ae90d2a4d56c.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_442296ac43577190f7e13ce10ffa179c.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_05b530c2b5e0b8d9bdb650601b829a26.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_689e8d7c546ea9f904a2198f679e4375.jpg',
                'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_e02989dca907c2f91e0c5f68db91dcd9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_c68ca669d49e09c0cbc115228908ca75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_482a01d9307d668d7820f7b9a133f57f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_53434a6695a44e2ae3169e8433d4ad0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_31e238009626209cb139c60468749b5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_61326123251f368e0011c27bb85a1f12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64099,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_1ea5e7687fdd5c8f24d1ae90d2a4d56c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_442296ac43577190f7e13ce10ffa179c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_05b530c2b5e0b8d9bdb650601b829a26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55234,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_689e8d7c546ea9f904a2198f679e4375.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_004ed81a-173c-54ba-adc0-8d6e5b6a693e/004ed81a-173c-54ba-adc0-8d6e5b6a693e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/8c/758c21425a10be6727081366caceae1d/pa/DN86096_e02989dca907c2f91e0c5f68db91dcd9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-07-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN86096%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Saving data for DN86096: {'created_time': 1774723339.350622, 'last_price_update_time': 1774723339.350636, 'auction_closing_time': 1774884413.0}
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN86096') HTTP/1.1" 204 0
2026-03-28 18:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for NG57043: 1
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_8b3d9e4fafec5d584c142df3cb3382bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8b3d9e4fafec5d584c142df3cb3382bf.jpg not downloaded yet
2026-03-28 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JM65569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for XA48872: 1
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_8cbcd57cbadf2709736ca8388136281a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8cbcd57cbadf2709736ca8388136281a.jpg not downloaded yet
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for ZZ30319: 1
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_23ebb30e6c38ef5cb849de7dac77dca8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_23ebb30e6c38ef5cb849de7dac77dca8.jpg not downloaded yet
2026-03-28 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_1747080a0d35301a2168f555fc213d05.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_ca3462641e5ca1f220f0fff5bc71d78e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for FJ78997: 1
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_46878f0c870f3d0c0dd12f11207625d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_46878f0c870f3d0c0dd12f11207625d8.jpg not downloaded yet
2026-03-28 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_54121368e64302b4102975bd63f6692f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_2ca277abf2ad0384a4c6fc967330f1f6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_38236dbb110c083c02234db6dccf0b0b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_83ac8630fedd46fcba6a7f7f850fae7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_35fc460d6dfec40554a78c73a6243c2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-28 18:42:19 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [auto1.de] INFO: Scrape type for SC04632: 2
2026-03-28 18:42:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with identifier: SC04632
2026-03-28 18:42:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with scrape type 2
2026-03-28 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with scrape type 2
2026-03-28 18:42:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e, identifier: SC04632
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_f0140dfc7265e340077c746d59f1ac2d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_f0140dfc7265e340077c746d59f1ac2d.jpg not downloaded yet
2026-03-28 18:42:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with identifier: SC04632
2026-03-28 18:42:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with identifier: SC04632
2026-03-28 18:42:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 357aec1a-ebd2-58e2-9b9d-d045bd1c451e with identifier: SC04632 to the API
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:13:52Z',
 'fuel_type': 'petrol',
 'id': '357aec1a-ebd2-58e2-9b9d-d045bd1c451e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC04632',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 128984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1990-08-02',
 'seller_name': None,
 'title': 'BMW 5er 525i',
 'transmission': 'manual',
 'trim': '',
 'year': 1990}
2026-03-28 18:42:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC04632%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [auto1.de] INFO: Saving data for SC04632: {'auction_closing_time': 1774883632.0, 'created_time': 1773301139.768602, 'last_price_update_time': 1774723340.006628}
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC04632') HTTP/1.1" 204 0
2026-03-28 18:42:20 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [auto1.de] INFO: Scrape type for CA87929: 1
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_9f16523436634ccfbd9e54652df14a14.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_9f16523436634ccfbd9e54652df14a14.jpg not downloaded yet
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd7bad0>
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_1747080a0d35301a2168f555fc213d05.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_1747080a0d35301a2168f555fc213d05.jpg saved to cache
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a468438a-4dec-5f5a-892f-8210f599ecc3
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be72990>
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_ca3462641e5ca1f220f0fff5bc71d78e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_ca3462641e5ca1f220f0fff5bc71d78e.jpg saved to cache
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70083eab-e53b-54ac-8b5d-27b9b357742d
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d458d0>
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F9a%252F339abbcd68e3c22fa2b0e0f17b12f035%252Fpa%252FKC29293_54121368e64302b4102975bd63f6692f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_54121368e64302b4102975bd63f6692f.jpg saved to cache
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70083eab-e53b-54ac-8b5d-27b9b357742d
2026-03-28 18:42:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70083eab-e53b-54ac-8b5d-27b9b357742d, skipping ID generation
2026-03-28 18:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70083eab-e53b-54ac-8b5d-27b9b357742d with scrape type 1
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70083eab-e53b-54ac-8b5d-27b9b357742d sending to next pipeline
2026-03-28 18:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70083eab-e53b-54ac-8b5d-27b9b357742d, identifier: KC29293
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b03d390>
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_2ca277abf2ad0384a4c6fc967330f1f6.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_2ca277abf2ad0384a4c6fc967330f1f6.jpg saved to cache
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a468438a-4dec-5f5a-892f-8210f599ecc3
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bce7810>
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_38236dbb110c083c02234db6dccf0b0b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_38236dbb110c083c02234db6dccf0b0b.jpg saved to cache
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a468438a-4dec-5f5a-892f-8210f599ecc3
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb08290>
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_83ac8630fedd46fcba6a7f7f850fae7d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_83ac8630fedd46fcba6a7f7f850fae7d.jpg saved to cache
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b065fd0>
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252Fee%252Fb8ee40758f9953565d4ce137287dcda5%252Fpa%252FGZ74020_35fc460d6dfec40554a78c73a6243c2e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_35fc460d6dfec40554a78c73a6243c2e.jpg saved to cache
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a468438a-4dec-5f5a-892f-8210f599ecc3
2026-03-28 18:42:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a468438a-4dec-5f5a-892f-8210f599ecc3, skipping ID generation
2026-03-28 18:42:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a468438a-4dec-5f5a-892f-8210f599ecc3 with scrape type 1
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a468438a-4dec-5f5a-892f-8210f599ecc3 sending to next pipeline
2026-03-28 18:42:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a468438a-4dec-5f5a-892f-8210f599ecc3, identifier: GZ74020
2026-03-28 18:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_a37dd8e8cb3e39df7a8065aec2c47989.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_4a62496747ef5b595beaa2f2ce57c158.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8cbcd57cbadf2709736ca8388136281a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8b3d9e4fafec5d584c142df3cb3382bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:20 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [auto1.de] INFO: Scrape type for GL40281: 1
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_146d95548a20fd094002e81378c3f353.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_146d95548a20fd094002e81378c3f353.jpg not downloaded yet
2026-03-28 18:42:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL24807/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70083eab-e53b-54ac-8b5d-27b9b357742d with identifier: KC29293
2026-03-28 18:42:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70083eab-e53b-54ac-8b5d-27b9b357742d with identifier: KC29293
2026-03-28 18:42:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70083eab-e53b-54ac-8b5d-27b9b357742d with identifier: KC29293 to the API
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_54121368e64302b4102975bd63f6692f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:18:18Z',
 'fuel_type': 'petrol',
 'id': '70083eab-e53b-54ac-8b5d-27b9b357742d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC29293',
 'listing': 'auction',
 'location': 'Kaufbeuren',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 124060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_bb1f34f49bb1ae7465ef95308b8a3dfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_54121368e64302b4102975bd63f6692f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_ca3462641e5ca1f220f0fff5bc71d78e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_382f5d6463027c03585c9b2d3f1109ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70083eab-e53b-54ac-8b5d-27b9b357742d/70083eab-e53b-54ac-8b5d-27b9b357742d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/9a/339abbcd68e3c22fa2b0e0f17b12f035/pa/KC29293_bce08ed84ecf3ff763c97471de5689ad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-11-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 1.4 Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2009}
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC29293%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Saving data for KC29293: {'created_time': 1774723341.031666, 'last_price_update_time': 1774723341.031679, 'auction_closing_time': 1774883898.0}
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC29293') HTTP/1.1" 204 0
2026-03-28 18:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a468438a-4dec-5f5a-892f-8210f599ecc3 with identifier: GZ74020
2026-03-28 18:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a468438a-4dec-5f5a-892f-8210f599ecc3 with identifier: GZ74020
2026-03-28 18:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a468438a-4dec-5f5a-892f-8210f599ecc3 with identifier: GZ74020 to the API
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_35fc460d6dfec40554a78c73a6243c2e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:00:00Z',
 'fuel_type': 'petrol',
 'id': 'a468438a-4dec-5f5a-892f-8210f599ecc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ74020',
 'listing': 'auction',
 'location': 'DE, Norderstedt',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 86721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_73f1849eba0db7e9a6e99c6c3790fa3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_2ca277abf2ad0384a4c6fc967330f1f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_38236dbb110c083c02234db6dccf0b0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94352,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_1747080a0d35301a2168f555fc213d05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a468438a-4dec-5f5a-892f-8210f599ecc3/a468438a-4dec-5f5a-892f-8210f599ecc3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 138602,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/ee/b8ee40758f9953565d4ce137287dcda5/pa/GZ74020_35fc460d6dfec40554a78c73a6243c2e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2012}
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ74020%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Saving data for GZ74020: {'created_time': 1774723341.477084, 'last_price_update_time': 1774723341.477097, 'auction_closing_time': 1774882800.0}
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ74020') HTTP/1.1" 204 0
2026-03-28 18:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_46878f0c870f3d0c0dd12f11207625d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for WC65602: 1
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_b761ad7fdbadf8fe718725eb3838bd75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_b761ad7fdbadf8fe718725eb3838bd75.jpg not downloaded yet
2026-03-28 18:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VE13678> (referer: https://www.auto1.com/v1/car-details-view/VE13678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TV59519/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC60426> (referer: https://www.auto1.com/v1/car-details-view/KC60426/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ33681> (referer: https://www.auto1.com/v1/car-details-view/GZ33681/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd98b50>
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252F24%252Fd124d791effe95cdcee6e855065f4b05%252Fpa%252FXT42092_a37dd8e8cb3e39df7a8065aec2c47989.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_a37dd8e8cb3e39df7a8065aec2c47989.jpg saved to cache
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d2803ca-911b-5581-9411-59cbdfc1346b
2026-03-28 18:42:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d2803ca-911b-5581-9411-59cbdfc1346b, skipping ID generation
2026-03-28 18:42:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d2803ca-911b-5581-9411-59cbdfc1346b with scrape type 1
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d2803ca-911b-5581-9411-59cbdfc1346b sending to next pipeline
2026-03-28 18:42:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d2803ca-911b-5581-9411-59cbdfc1346b, identifier: XT42092
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc5fb90>
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_4a62496747ef5b595beaa2f2ce57c158.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_4a62496747ef5b595beaa2f2ce57c158.jpg saved to cache
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beafa50>
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_8cbcd57cbadf2709736ca8388136281a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8cbcd57cbadf2709736ca8388136281a.jpg saved to cache
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beafa50>
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_8b3d9e4fafec5d584c142df3cb3382bf.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8b3d9e4fafec5d584c142df3cb3382bf.jpg saved to cache
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:21 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [auto1.de] INFO: Scrape type for HF13996: 1
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_8a8ec48779dc271ec20e08eb3b7d7382.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8a8ec48779dc271ec20e08eb3b7d7382.jpg not downloaded yet
2026-03-28 18:42:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d2803ca-911b-5581-9411-59cbdfc1346b with identifier: XT42092
2026-03-28 18:42:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d2803ca-911b-5581-9411-59cbdfc1346b with identifier: XT42092
2026-03-28 18:42:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d2803ca-911b-5581-9411-59cbdfc1346b with identifier: XT42092 to the API
2026-03-28 18:42:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_a37dd8e8cb3e39df7a8065aec2c47989.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:43Z',
 'fuel_type': 'diesel',
 'id': '9d2803ca-911b-5581-9411-59cbdfc1346b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT42092',
 'listing': 'auction',
 'location': 'DE, Heilbronn',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 105775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_080ff723c46845b6937831c02805f9d1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_1d2a0c6d85d17de2b1ef0f1e2c6ad879.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_a37dd8e8cb3e39df7a8065aec2c47989.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_d8fdae90fd77a936f06d29eb0de65f2f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_578cd8c4789859e11dfc287e3e2c7667.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82288,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_e1d5c033965fd14b681b5518f278d380.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_7320f47201237aa48ef194fda283d068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78660,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_dea1a6db716052582b32988c9167d77c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_ae9338ae1cb8c1090bf4be89fe8aba58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d2803ca-911b-5581-9411-59cbdfc1346b/9d2803ca-911b-5581-9411-59cbdfc1346b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/24/d124d791effe95cdcee6e855065f4b05/pa/XT42092_32577c73f2754e3c4480b8c687c545d4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2016}
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42092%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [auto1.de] INFO: Saving data for XT42092: {'created_time': 1774723342.231971, 'last_price_update_time': 1774723342.231982, 'auction_closing_time': 1774885123.0}
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT42092') HTTP/1.1" 204 0
2026-03-28 18:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_f0140dfc7265e340077c746d59f1ac2d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:22 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [auto1.de] INFO: Scrape type for RX58241: 2
2026-03-28 18:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10270847-2b1e-57c4-837c-63237a6962bf with identifier: RX58241
2026-03-28 18:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10270847-2b1e-57c4-837c-63237a6962bf with scrape type 2
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10270847-2b1e-57c4-837c-63237a6962bf with scrape type 2
2026-03-28 18:42:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10270847-2b1e-57c4-837c-63237a6962bf, identifier: RX58241
2026-03-28 18:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA48872/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_146d95548a20fd094002e81378c3f353.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10270847-2b1e-57c4-837c-63237a6962bf with identifier: RX58241
2026-03-28 18:42:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10270847-2b1e-57c4-837c-63237a6962bf with identifier: RX58241
2026-03-28 18:42:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10270847-2b1e-57c4-837c-63237a6962bf with identifier: RX58241 to the API
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:56:53Z',
 'fuel_type': 'petrol',
 'id': '10270847-2b1e-57c4-837c-63237a6962bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX58241',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 112624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-15',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX58241%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [auto1.de] INFO: Saving data for RX58241: {'auction_closing_time': 1774886213.0, 'created_time': 1774349362.290389, 'last_price_update_time': 1774723342.693037}
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX58241') HTTP/1.1" 204 0
2026-03-28 18:42:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b015590>
2026-03-28 18:42:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_46878f0c870f3d0c0dd12f11207625d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_46878f0c870f3d0c0dd12f11207625d8.jpg saved to cache
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d594647c-0e3b-5e23-9586-5da2babfe355 with identifier: VE13678
2026-03-28 18:42:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d594647c-0e3b-5e23-9586-5da2babfe355 with scrape type 1
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d594647c-0e3b-5e23-9586-5da2babfe355
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_fedfb65126029ff2f519ac8f502932da.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_fedfb65126029ff2f519ac8f502932da.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_89f22022ab468d60ad52359ac0722289.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_89f22022ab468d60ad52359ac0722289.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_05002c44a11b7b9082932ef4d3f073c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_05002c44a11b7b9082932ef4d3f073c4.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_ab02e7dd9875127fb5278a02b124dc8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_ab02e7dd9875127fb5278a02b124dc8e.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_e9ba033a8718bf3a521e5862691c805d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_e9ba033a8718bf3a521e5862691c805d.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_be93ef40c59dedfac9481a5e93a520e4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_be93ef40c59dedfac9481a5e93a520e4.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_6af70287f3013d5cd47906cc455fc61a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_6af70287f3013d5cd47906cc455fc61a.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_a31e8b3d3041aaf8a99e26a7ea901c0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_a31e8b3d3041aaf8a99e26a7ea901c0d.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_11f119112c7ca261b222a1ad9c29f779.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_11f119112c7ca261b222a1ad9c29f779.jpg already downloaded
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8d%252F1d%252F8d1d8ed732d4af9468236512c87171b8%252Fpa%252FVE13678_e07685e8224299f42c0d6a6d483c9909.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_e07685e8224299f42c0d6a6d483c9909.jpg already downloaded
2026-03-28 18:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d594647c-0e3b-5e23-9586-5da2babfe355, identifier: VE13678
2026-03-28 18:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with identifier: KC60426
2026-03-28 18:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with scrape type 1
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_37a970894c6b7d6de6eeaf469cc429fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_37a970894c6b7d6de6eeaf469cc429fb.jpg not downloaded yet
2026-03-28 18:42:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40315824-4e52-538b-a3c2-077ef297edf1 with identifier: GZ33681
2026-03-28 18:42:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40315824-4e52-538b-a3c2-077ef297edf1 with scrape type 1
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40315824-4e52-538b-a3c2-077ef297edf1
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_696e265538a6b76600372d8639cfe826.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_696e265538a6b76600372d8639cfe826.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_829d7e765da9385ca30ebbb329afcb36.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_829d7e765da9385ca30ebbb329afcb36.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_976a587fd079f501af8b02ac9e4653b1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_976a587fd079f501af8b02ac9e4653b1.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_96c3e4c4ab39dcd4747ed1b4bab552be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_96c3e4c4ab39dcd4747ed1b4bab552be.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_c083e4457a9b4f0a2653ce132ea8f6de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_c083e4457a9b4f0a2653ce132ea8f6de.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_815fdd84a06d8f9be409105421a27cae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_815fdd84a06d8f9be409105421a27cae.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_06bc20eba3c9a00c3916b550cab72f3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_06bc20eba3c9a00c3916b550cab72f3f.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_c94f3d3362cde8602cc8afcd07c74924.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_c94f3d3362cde8602cc8afcd07c74924.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_dac3ed9b57485ef9748ec50b860d3b55.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_dac3ed9b57485ef9748ec50b860d3b55.jpg already downloaded
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F45%252F84455cf1a334af5032156b47c312e8c2%252Fpa%252FGZ33681_294162cdf9f8857f4f2db880ea9b368f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_294162cdf9f8857f4f2db880ea9b368f.jpg already downloaded
2026-03-28 18:42:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 40315824-4e52-538b-a3c2-077ef297edf1, identifier: GZ33681
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-28 18:42:23 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [auto1.de] INFO: Scrape type for VN03026: 1
2026-03-28 18:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d594647c-0e3b-5e23-9586-5da2babfe355 with identifier: VE13678
2026-03-28 18:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d594647c-0e3b-5e23-9586-5da2babfe355 with identifier: VE13678
2026-03-28 18:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d594647c-0e3b-5e23-9586-5da2babfe355 with identifier: VE13678 to the API
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VE13678>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:28:56Z',
 'fuel_type': 'petrol',
 'id': 'd594647c-0e3b-5e23-9586-5da2babfe355',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE13678',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 124567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_fedfb65126029ff2f519ac8f502932da.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_89f22022ab468d60ad52359ac0722289.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_05002c44a11b7b9082932ef4d3f073c4.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_ab02e7dd9875127fb5278a02b124dc8e.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_e9ba033a8718bf3a521e5862691c805d.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_be93ef40c59dedfac9481a5e93a520e4.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_6af70287f3013d5cd47906cc455fc61a.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_a31e8b3d3041aaf8a99e26a7ea901c0d.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_11f119112c7ca261b222a1ad9c29f779.jpg',
                'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_e07685e8224299f42c0d6a6d483c9909.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2880126,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_fedfb65126029ff2f519ac8f502932da.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2866485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_89f22022ab468d60ad52359ac0722289.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_05002c44a11b7b9082932ef4d3f073c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_ab02e7dd9875127fb5278a02b124dc8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_e9ba033a8718bf3a521e5862691c805d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_be93ef40c59dedfac9481a5e93a520e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_6af70287f3013d5cd47906cc455fc61a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2756340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_a31e8b3d3041aaf8a99e26a7ea901c0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710634,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_11f119112c7ca261b222a1ad9c29f779.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d594647c-0e3b-5e23-9586-5da2babfe355/d594647c-0e3b-5e23-9586-5da2babfe355_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8d/1d/8d1d8ed732d4af9468236512c87171b8/pa/VE13678_e07685e8224299f42c0d6a6d483c9909.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2015}
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE13678%27 HTTP/1.1" 200 None
2026-03-28 18:42:23 [auto1.de] INFO: Saving data for VE13678: {'created_time': 1774723343.749159, 'last_price_update_time': 1774723343.749172, 'auction_closing_time': 1774884536.0}
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE13678') HTTP/1.1" 204 0
2026-03-28 18:42:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 40315824-4e52-538b-a3c2-077ef297edf1 with identifier: GZ33681
2026-03-28 18:42:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 40315824-4e52-538b-a3c2-077ef297edf1 with identifier: GZ33681
2026-03-28 18:42:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 40315824-4e52-538b-a3c2-077ef297edf1 with identifier: GZ33681 to the API
2026-03-28 18:42:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GZ33681>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:55:31Z',
 'fuel_type': 'petrol',
 'id': '40315824-4e52-538b-a3c2-077ef297edf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ33681',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 80562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_696e265538a6b76600372d8639cfe826.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_829d7e765da9385ca30ebbb329afcb36.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_976a587fd079f501af8b02ac9e4653b1.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_96c3e4c4ab39dcd4747ed1b4bab552be.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_c083e4457a9b4f0a2653ce132ea8f6de.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_815fdd84a06d8f9be409105421a27cae.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_06bc20eba3c9a00c3916b550cab72f3f.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_c94f3d3362cde8602cc8afcd07c74924.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_dac3ed9b57485ef9748ec50b860d3b55.jpg',
                'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_294162cdf9f8857f4f2db880ea9b368f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82968,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_696e265538a6b76600372d8639cfe826.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79471,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_829d7e765da9385ca30ebbb329afcb36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80585,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_976a587fd079f501af8b02ac9e4653b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_96c3e4c4ab39dcd4747ed1b4bab552be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_c083e4457a9b4f0a2653ce132ea8f6de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_815fdd84a06d8f9be409105421a27cae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_06bc20eba3c9a00c3916b550cab72f3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89680,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_c94f3d3362cde8602cc8afcd07c74924.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_dac3ed9b57485ef9748ec50b860d3b55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40315824-4e52-538b-a3c2-077ef297edf1/40315824-4e52-538b-a3c2-077ef297edf1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/45/84455cf1a334af5032156b47c312e8c2/pa/GZ33681_294162cdf9f8857f4f2db880ea9b368f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Dokker 1.2 TCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2019}
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ33681%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Saving data for GZ33681: {'created_time': 1774723344.267802, 'last_price_update_time': 1774723344.267815, 'auction_closing_time': 1774886131.0}
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ33681') HTTP/1.1" 204 0
2026-03-28 18:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_6871e47d55e8cd3e5f740ac132f449fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_0fcf67c66e3f67e2037a165bebc158d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_0fcf67c66e3f67e2037a165bebc158d3.jpg not downloaded yet
2026-03-28 18:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG57043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ30319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bedbcd0>
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_f0140dfc7265e340077c746d59f1ac2d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_f0140dfc7265e340077c746d59f1ac2d.jpg saved to cache
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_b761ad7fdbadf8fe718725eb3838bd75.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for NS77188: 1
2026-03-28 18:42:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b081a90>
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_146d95548a20fd094002e81378c3f353.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_146d95548a20fd094002e81378c3f353.jpg saved to cache
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_4377412f70dac315d99a47565e79583d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_4377412f70dac315d99a47565e79583d.jpg not downloaded yet
2026-03-28 18:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8a8ec48779dc271ec20e08eb3b7d7382.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for GT32005: 1
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_e6484c6063ebb0b03bf47408c0ac832d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_e6484c6063ebb0b03bf47408c0ac832d.jpg not downloaded yet
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-28 18:42:24 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Scrape type for SF89930: 2
2026-03-28 18:42:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be345a10-8431-5673-aeb0-e14a23f9b714 with identifier: SF89930
2026-03-28 18:42:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be345a10-8431-5673-aeb0-e14a23f9b714 with scrape type 2
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be345a10-8431-5673-aeb0-e14a23f9b714 with scrape type 2
2026-03-28 18:42:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be345a10-8431-5673-aeb0-e14a23f9b714, identifier: SF89930
2026-03-28 18:42:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be345a10-8431-5673-aeb0-e14a23f9b714 with identifier: SF89930
2026-03-28 18:42:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be345a10-8431-5673-aeb0-e14a23f9b714 with identifier: SF89930
2026-03-28 18:42:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be345a10-8431-5673-aeb0-e14a23f9b714 with identifier: SF89930 to the API
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:15:04Z',
 'fuel_type': 'diesel',
 'id': 'be345a10-8431-5673-aeb0-e14a23f9b714',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF89930',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 62786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 110 CDI FWD lang',
 'transmission': 'automatic',
 'trim': 'FWD lang',
 'year': 2020}
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF89930%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [auto1.de] INFO: Saving data for SF89930: {'auction_closing_time': 1774883704.0, 'created_time': 1774521437.16494, 'last_price_update_time': 1774723344.92724}
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF89930') HTTP/1.1" 204 0
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_d9ca04e540016ea9b28d6a01c0179cb7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_d9ca04e540016ea9b28d6a01c0179cb7.jpg not downloaded yet
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb54f50>
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_6871e47d55e8cd3e5f740ac132f449fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_6871e47d55e8cd3e5f740ac132f449fa.jpg saved to cache
2026-03-28 18:42:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_37a970894c6b7d6de6eeaf469cc429fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for FF09080: 1
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_c9c7c98b761fc92dd5467f8b316b3cfc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_c9c7c98b761fc92dd5467f8b316b3cfc.jpg not downloaded yet
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b3c50>
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_b761ad7fdbadf8fe718725eb3838bd75.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_b761ad7fdbadf8fe718725eb3838bd75.jpg saved to cache
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c0390>
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_8a8ec48779dc271ec20e08eb3b7d7382.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8a8ec48779dc271ec20e08eb3b7d7382.jpg saved to cache
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU36975%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for XU36975: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF23902%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for NF23902: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR04886%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for TR04886: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR73784%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for JR73784: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK15682%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [auto1.de] INFO: Scrape type for TK15682: 0
2026-03-28 18:42:25 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-28 18:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL40281/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CA87929/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_8ba500d2291e36036b8b496e98ed8755.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_8ba500d2291e36036b8b496e98ed8755.jpg not downloaded yet
2026-03-28 18:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KT60539> (referer: https://www.auto1.com/v1/car-details-view/KT60539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JM65569> (referer: https://www.auto1.com/v1/car-details-view/JM65569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FJ78997/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd30250>
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_37a970894c6b7d6de6eeaf469cc429fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_37a970894c6b7d6de6eeaf469cc429fb.jpg saved to cache
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_61c56383d946c81361db6292b4165695.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_61c56383d946c81361db6292b4165695.jpg not downloaded yet
2026-03-28 18:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_e6484c6063ebb0b03bf47408c0ac832d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_20a8a5b0bc7193b4c8f8f5bdbfcadc7d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_20a8a5b0bc7193b4c8f8f5bdbfcadc7d.jpg not downloaded yet
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_974a85b0bda8cbf236314f5c3448bc8e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_974a85b0bda8cbf236314f5c3448bc8e.jpg not downloaded yet
2026-03-28 18:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13fe999f-d980-5b0c-918f-8c224e9e66ac with identifier: KT60539
2026-03-28 18:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13fe999f-d980-5b0c-918f-8c224e9e66ac with scrape type 1
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_ca2c11886fea88bbb3a8457116c788dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_ca2c11886fea88bbb3a8457116c788dd.jpg not downloaded yet
2026-03-28 18:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17b58079-2060-5ffb-b0cd-6c9b7f790662 with identifier: JM65569
2026-03-28 18:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17b58079-2060-5ffb-b0cd-6c9b7f790662 with scrape type 1
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 17b58079-2060-5ffb-b0cd-6c9b7f790662
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af6046e1bb68a70d8bb85a08ca9f3a%252Fpa%252FJM65569_01c15df7d36af2e45d77b12c4332c801.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_01c15df7d36af2e45d77b12c4332c801.jpg already downloaded
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af6046e1bb68a70d8bb85a08ca9f3a%252Fpa%252FJM65569_ad5b8a32892a52bf94b1eafc0d12955a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_ad5b8a32892a52bf94b1eafc0d12955a.jpg already downloaded
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af6046e1bb68a70d8bb85a08ca9f3a%252Fpa%252FJM65569_a437ff000ee7d97542e79bddaa20fd17.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_a437ff000ee7d97542e79bddaa20fd17.jpg already downloaded
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af6046e1bb68a70d8bb85a08ca9f3a%252Fpa%252FJM65569_55b5127c273796ae1ff97addde2cc462.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_55b5127c273796ae1ff97addde2cc462.jpg already downloaded
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af6046e1bb68a70d8bb85a08ca9f3a%252Fpa%252FJM65569_46d9f2675cf1b3fce81645e6ac140790.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_46d9f2675cf1b3fce81645e6ac140790.jpg already downloaded
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Faf%252Ff4af6046e1bb68a70d8bb85a08ca9f3a%252Fpa%252FJM65569_e930564f2af1b9b1f5e9068a0cea3d0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_e930564f2af1b9b1f5e9068a0cea3d0d.jpg already downloaded
2026-03-28 18:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17b58079-2060-5ffb-b0cd-6c9b7f790662, identifier: JM65569
2026-03-28 18:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17b58079-2060-5ffb-b0cd-6c9b7f790662 with identifier: JM65569
2026-03-28 18:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17b58079-2060-5ffb-b0cd-6c9b7f790662 with identifier: JM65569
2026-03-28 18:42:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17b58079-2060-5ffb-b0cd-6c9b7f790662 with identifier: JM65569 to the API
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JM65569>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:28:22Z',
 'fuel_type': 'petrol',
 'id': '17b58079-2060-5ffb-b0cd-6c9b7f790662',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM65569',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 87103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_01c15df7d36af2e45d77b12c4332c801.jpg',
                'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_ad5b8a32892a52bf94b1eafc0d12955a.jpg',
                'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_a437ff000ee7d97542e79bddaa20fd17.jpg',
                'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_55b5127c273796ae1ff97addde2cc462.jpg',
                'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_46d9f2675cf1b3fce81645e6ac140790.jpg',
                'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_e930564f2af1b9b1f5e9068a0cea3d0d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b58079-2060-5ffb-b0cd-6c9b7f790662/17b58079-2060-5ffb-b0cd-6c9b7f790662_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_01c15df7d36af2e45d77b12c4332c801.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b58079-2060-5ffb-b0cd-6c9b7f790662/17b58079-2060-5ffb-b0cd-6c9b7f790662_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118565,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_ad5b8a32892a52bf94b1eafc0d12955a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b58079-2060-5ffb-b0cd-6c9b7f790662/17b58079-2060-5ffb-b0cd-6c9b7f790662_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_a437ff000ee7d97542e79bddaa20fd17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b58079-2060-5ffb-b0cd-6c9b7f790662/17b58079-2060-5ffb-b0cd-6c9b7f790662_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_55b5127c273796ae1ff97addde2cc462.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b58079-2060-5ffb-b0cd-6c9b7f790662/17b58079-2060-5ffb-b0cd-6c9b7f790662_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_46d9f2675cf1b3fce81645e6ac140790.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_17b58079-2060-5ffb-b0cd-6c9b7f790662/17b58079-2060-5ffb-b0cd-6c9b7f790662_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79028,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/af/f4af6046e1bb68a70d8bb85a08ca9f3a/pa/JM65569_e930564f2af1b9b1f5e9068a0cea3d0d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM65569%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [auto1.de] INFO: Saving data for JM65569: {'created_time': 1774723346.031425, 'last_price_update_time': 1774723346.031436, 'auction_closing_time': 1774884502.0}
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM65569') HTTP/1.1" 204 0
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_8ba500d2291e36036b8b496e98ed8755.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_0769e12b6d1b681f1e2fb5cb0810dc66.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_0769e12b6d1b681f1e2fb5cb0810dc66.jpg not downloaded yet
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd31190>
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_e6484c6063ebb0b03bf47408c0ac832d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_e6484c6063ebb0b03bf47408c0ac832d.jpg saved to cache
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_826d6af49105e1b6cc0941a9eec904b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_826d6af49105e1b6cc0941a9eec904b2.jpg not downloaded yet
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZA82087> (referer: https://www.auto1.com/v1/car-details-view/ZA82087/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL24807> (referer: https://www.auto1.com/v1/car-details-view/VL24807/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_c9c7c98b761fc92dd5467f8b316b3cfc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_d9ca04e540016ea9b28d6a01c0179cb7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_98ddbe987028a42d2c1f06f3bc86c237.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_98ddbe987028a42d2c1f06f3bc86c237.jpg not downloaded yet
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HF13996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_1ea1d217981cfb033fe91da5763c0f2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_1ea1d217981cfb033fe91da5763c0f2a.jpg not downloaded yet
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_2fdc0ee3cb4e7851d93f23ce1b5da1ab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_2fdc0ee3cb4e7851d93f23ce1b5da1ab.jpg not downloaded yet
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_23ebb30e6c38ef5cb849de7dac77dca8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26e2d0>
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_8ba500d2291e36036b8b496e98ed8755.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_8ba500d2291e36036b8b496e98ed8755.jpg saved to cache
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_3b24e74768e9264cc24ac34d3fc82d81.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_3b24e74768e9264cc24ac34d3fc82d81.jpg not downloaded yet
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_3df508b67e7a58ac95b200de4c8fe744.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_ca2c11886fea88bbb3a8457116c788dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_0769e12b6d1b681f1e2fb5cb0810dc66.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_887ca953f672a55c14ae4a13950bda00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_887ca953f672a55c14ae4a13950bda00.jpg not downloaded yet
2026-03-28 18:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with identifier: ZA82087
2026-03-28 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with scrape type 1
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_3d27bd77eb547ed3960c1740c39e631f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_3d27bd77eb547ed3960c1740c39e631f.jpg not downloaded yet
2026-03-28 18:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5710373-7d5f-5f2c-9026-e234d39ef950 with identifier: VL24807
2026-03-28 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5710373-7d5f-5f2c-9026-e234d39ef950 with scrape type 1
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_1134c4151fd26542272a14bfaaddf042.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_1134c4151fd26542272a14bfaaddf042.jpg not downloaded yet
2026-03-28 18:42:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bebffd0>
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_c9c7c98b761fc92dd5467f8b316b3cfc.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_c9c7c98b761fc92dd5467f8b316b3cfc.jpg saved to cache
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf7210>
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_d9ca04e540016ea9b28d6a01c0179cb7.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_d9ca04e540016ea9b28d6a01c0179cb7.jpg saved to cache
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_9f16523436634ccfbd9e54652df14a14.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_f31a190bc8336d0b1581c1f252135704.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_f31a190bc8336d0b1581c1f252135704.jpg not downloaded yet
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_69932ce3629eee105668d5a25c4a3550.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_69932ce3629eee105668d5a25c4a3550.jpg not downloaded yet
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_bf730399088667646733dbb9f7a37304.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_bf730399088667646733dbb9f7a37304.jpg not downloaded yet
2026-03-28 18:42:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_826d6af49105e1b6cc0941a9eec904b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_5d77c5feb6d8edaadd69b5e5bf0e0a8a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_5d77c5feb6d8edaadd69b5e5bf0e0a8a.jpg not downloaded yet
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_c3dc6c8466437f4099b761ceb52b8e0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_c3dc6c8466437f4099b761ceb52b8e0c.jpg not downloaded yet
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_3fb4acb1342c6a4a8e293997f90d1ef6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_3fb4acb1342c6a4a8e293997f90d1ef6.jpg not downloaded yet
2026-03-28 18:42:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd987d0>
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_23ebb30e6c38ef5cb849de7dac77dca8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_23ebb30e6c38ef5cb849de7dac77dca8.jpg saved to cache
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc962d0>
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252F4f%252Fc74f32c02994d6305cd65cc4971347d8%252Fpa%252FER27214_3df508b67e7a58ac95b200de4c8fe744.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_3df508b67e7a58ac95b200de4c8fe744.jpg saved to cache
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16
2026-03-28 18:42:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16, skipping ID generation
2026-03-28 18:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with scrape type 1
2026-03-28 18:42:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 sending to next pipeline
2026-03-28 18:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16, identifier: ER27214
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2ab090>
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_ca2c11886fea88bbb3a8457116c788dd.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_ca2c11886fea88bbb3a8457116c788dd.jpg saved to cache
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda72d0>
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_0769e12b6d1b681f1e2fb5cb0810dc66.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_0769e12b6d1b681f1e2fb5cb0810dc66.jpg saved to cache
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_ef7a18d05ef832070bd3a66731c0983b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_ef7a18d05ef832070bd3a66731c0983b.jpg not downloaded yet
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_c415ae2d74db2f1494d2ba69ea2b0f67.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_c415ae2d74db2f1494d2ba69ea2b0f67.jpg not downloaded yet
2026-03-28 18:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with identifier: ER27214
2026-03-28 18:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with identifier: ER27214
2026-03-28 18:42:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5af9afd0-6f46-55e8-9755-ce8e7ff28a16 with identifier: ER27214 to the API
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_3df508b67e7a58ac95b200de4c8fe744.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:54:31Z',
 'fuel_type': 'petrol',
 'id': '5af9afd0-6f46-55e8-9755-ce8e7ff28a16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER27214',
 'listing': 'auction',
 'location': 'DE, München',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 213423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3203298,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_3df508b67e7a58ac95b200de4c8fe744.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_619172fb0f46aca094ee7997670b4f7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_0b75f0e842d64436f8b9a62a03ea07cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2940656,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_37d45076f11fa80309b6dea54189df64.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85073,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_a5446da3d0e1be53ab9194d16427362e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_7a0d484dc4cc476f4d0096829c4f0ed4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_8182eb150c693cde8672781dd4d0da54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2950274,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_b2aaf6b79421fbc58cb955bb94af17e1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_1db6fffacba700516ddd2fb5690b478e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af9afd0-6f46-55e8-9755-ce8e7ff28a16/5af9afd0-6f46-55e8-9755-ce8e7ff28a16_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3074009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/4f/c74f32c02994d6305cd65cc4971347d8/pa/ER27214_7c5c2cbe10bfa4805c7003d983ed01de.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-07',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 250 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2012}
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER27214%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [auto1.de] INFO: Saving data for ER27214: {'created_time': 1774723347.541487, 'last_price_update_time': 1774723347.5415, 'auction_closing_time': 1774886071.0}
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER27214') HTTP/1.1" 204 0
2026-03-28 18:42:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd80610>
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252Fdf%252F00dfc609dcca7f27be30550356e00da5%252Fpa%252FAL30364_9f16523436634ccfbd9e54652df14a14.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_9f16523436634ccfbd9e54652df14a14.jpg saved to cache
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4000ab82-0858-5b4b-ae7e-708aef28a00e
2026-03-28 18:42:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4000ab82-0858-5b4b-ae7e-708aef28a00e, skipping ID generation
2026-03-28 18:42:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4000ab82-0858-5b4b-ae7e-708aef28a00e with scrape type 1
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4000ab82-0858-5b4b-ae7e-708aef28a00e sending to next pipeline
2026-03-28 18:42:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4000ab82-0858-5b4b-ae7e-708aef28a00e, identifier: AL30364
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_86b9d843c301534a47e2c009673cf3df.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_86b9d843c301534a47e2c009673cf3df.jpg not downloaded yet
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_a110f8f216508a9b5df78577187c3777.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_a110f8f216508a9b5df78577187c3777.jpg not downloaded yet
2026-03-28 18:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF09080/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TV59519> (referer: https://www.auto1.com/v1/car-details-view/TV59519/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA48872> (referer: https://www.auto1.com/v1/car-details-view/XA48872/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4000ab82-0858-5b4b-ae7e-708aef28a00e with identifier: AL30364
2026-03-28 18:42:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4000ab82-0858-5b4b-ae7e-708aef28a00e with identifier: AL30364
2026-03-28 18:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4000ab82-0858-5b4b-ae7e-708aef28a00e with identifier: AL30364 to the API
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_9f16523436634ccfbd9e54652df14a14.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:27:27Z',
 'fuel_type': 'petrol',
 'id': '4000ab82-0858-5b4b-ae7e-708aef28a00e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL30364',
 'listing': 'auction',
 'location': 'DE, Hamburg-Billstedt',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 78610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_6871e47d55e8cd3e5f740ac132f449fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8b3d9e4fafec5d584c142df3cb3382bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8cbcd57cbadf2709736ca8388136281a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2809439,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_23ebb30e6c38ef5cb849de7dac77dca8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_46878f0c870f3d0c0dd12f11207625d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89009,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_f0140dfc7265e340077c746d59f1ac2d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2651317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_9f16523436634ccfbd9e54652df14a14.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_146d95548a20fd094002e81378c3f353.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75310,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_b761ad7fdbadf8fe718725eb3838bd75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4000ab82-0858-5b4b-ae7e-708aef28a00e/4000ab82-0858-5b4b-ae7e-708aef28a00e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/df/00dfc609dcca7f27be30550356e00da5/pa/AL30364_8a8ec48779dc271ec20e08eb3b7d7382.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-28',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2019}
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL30364%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [auto1.de] INFO: Saving data for AL30364: {'created_time': 1774723348.294502, 'last_price_update_time': 1774723348.294514, 'auction_closing_time': 1774884447.0}
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL30364') HTTP/1.1" 204 0
2026-03-28 18:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VN03026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WC65602/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bddecd0>
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_826d6af49105e1b6cc0941a9eec904b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_826d6af49105e1b6cc0941a9eec904b2.jpg saved to cache
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_f72c6fb9cc90edbf5e58af98d6bf803b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_f72c6fb9cc90edbf5e58af98d6bf803b.jpg not downloaded yet
2026-03-28 18:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with identifier: TV59519
2026-03-28 18:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with scrape type 1
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_b6611bdf279ced12f112272cc9c9629b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_b6611bdf279ced12f112272cc9c9629b.jpg not downloaded yet
2026-03-28 18:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with identifier: XA48872
2026-03-28 18:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with scrape type 1
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_3fca4b43223ed14365991b1e706d3caa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_3fca4b43223ed14365991b1e706d3caa.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_2abd7972816e1f5e62aefbfd0f5e3e73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_2abd7972816e1f5e62aefbfd0f5e3e73.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_446a40275044991664bc4aa3d25e4ee8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_446a40275044991664bc4aa3d25e4ee8.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_87a6674638215cfa31cda6d8714987df.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_87a6674638215cfa31cda6d8714987df.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_d0829320681dfcc26e54d507d5406b71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_d0829320681dfcc26e54d507d5406b71.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_7bce5832a9a2b82d1f7c24dfc8bbf785.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_7bce5832a9a2b82d1f7c24dfc8bbf785.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_f15486cf47943fd737642bfa20cc4485.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f15486cf47943fd737642bfa20cc4485.jpg not downloaded yet
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_3fb4acb1342c6a4a8e293997f90d1ef6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_5d77c5feb6d8edaadd69b5e5bf0e0a8a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_c3dc6c8466437f4099b761ceb52b8e0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_86b9d843c301534a47e2c009673cf3df.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_aa5d6f6c6aae105070060fb2871ece0d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_aa5d6f6c6aae105070060fb2871ece0d.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_f1d5f019f5d686852c405ec38dbad2c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_f1d5f019f5d686852c405ec38dbad2c4.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_5878e5b94f73da5391e0659ae6b57300.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_5878e5b94f73da5391e0659ae6b57300.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_5f773a18072b12f21ddcd84386d972f0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_5f773a18072b12f21ddcd84386d972f0.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_83f21bf868eb9ebb760f42a53bb85b3f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_83f21bf868eb9ebb760f42a53bb85b3f.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_6ebd2a03ed95975d0511de9b2d613076.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_6ebd2a03ed95975d0511de9b2d613076.jpg not downloaded yet
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_bf730399088667646733dbb9f7a37304.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG57043> (referer: https://www.auto1.com/v1/car-details-view/NG57043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_ef7a18d05ef832070bd3a66731c0983b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_50c9b9cf37b29179a9a28a2cf9a6825f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_50c9b9cf37b29179a9a28a2cf9a6825f.jpg not downloaded yet
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_f42fe268c6d277f68c696907416945f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f42fe268c6d277f68c696907416945f7.jpg not downloaded yet
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FJ78997> (referer: https://www.auto1.com/v1/car-details-view/FJ78997/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b151010>
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_3fb4acb1342c6a4a8e293997f90d1ef6.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_3fb4acb1342c6a4a8e293997f90d1ef6.jpg saved to cache
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be80fd0>
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_5d77c5feb6d8edaadd69b5e5bf0e0a8a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_5d77c5feb6d8edaadd69b5e5bf0e0a8a.jpg saved to cache
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb67a90>
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_c3dc6c8466437f4099b761ceb52b8e0c.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_c3dc6c8466437f4099b761ceb52b8e0c.jpg saved to cache
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf6350>
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_86b9d843c301534a47e2c009673cf3df.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_86b9d843c301534a47e2c009673cf3df.jpg saved to cache
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_0998045d97bff5d83a121b65bb48aa5c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_0998045d97bff5d83a121b65bb48aa5c.jpg not downloaded yet
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_446a40275044991664bc4aa3d25e4ee8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ30319> (referer: https://www.auto1.com/v1/car-details-view/ZZ30319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_69932ce3629eee105668d5a25c4a3550.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_2a19672e3f2313a89001359bc13d9983.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_2a19672e3f2313a89001359bc13d9983.jpg not downloaded yet
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2b2c90>
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_bf730399088667646733dbb9f7a37304.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_bf730399088667646733dbb9f7a37304.jpg saved to cache
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d533799-fed8-5b1e-b969-134338c744db with identifier: NG57043
2026-03-28 18:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d533799-fed8-5b1e-b969-134338c744db with scrape type 1
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4d533799-fed8-5b1e-b969-134338c744db
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_f4e60fc797931af7a2db5fb726ba57ae.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_f4e60fc797931af7a2db5fb726ba57ae.jpg not downloaded yet
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb91690>
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_ef7a18d05ef832070bd3a66731c0983b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_ef7a18d05ef832070bd3a66731c0983b.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca
2026-03-28 18:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with identifier: FJ78997
2026-03-28 18:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with scrape type 1
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_394ec227ff402f2de63911b6efed81f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_394ec227ff402f2de63911b6efed81f2.jpg not downloaded yet
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_2abd7972816e1f5e62aefbfd0f5e3e73.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_9fb44a22df1b75b84268aafc0e5514c2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_9fb44a22df1b75b84268aafc0e5514c2.jpg not downloaded yet
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_b40429ee313e6f52f234f85a3a9a8cc9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_b40429ee313e6f52f234f85a3a9a8cc9.jpg not downloaded yet
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_3d9c2f3e1536592a6920305239304b87.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_3d9c2f3e1536592a6920305239304b87.jpg not downloaded yet
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc15a90>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_446a40275044991664bc4aa3d25e4ee8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_446a40275044991664bc4aa3d25e4ee8.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b
2026-03-28 18:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with identifier: ZZ30319
2026-03-28 18:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with scrape type 1
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_87906f7bb56a0881c8b1d5397dd619fe.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_87906f7bb56a0881c8b1d5397dd619fe.jpg not downloaded yet
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be93cd0>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_69932ce3629eee105668d5a25c4a3550.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_69932ce3629eee105668d5a25c4a3550.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_5f773a18072b12f21ddcd84386d972f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_0789cbffa75c3e8651b89a84383f024c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_0789cbffa75c3e8651b89a84383f024c.jpg not downloaded yet
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_7a880b4a9f7104e9d4aadb4ad5667d2b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_7a880b4a9f7104e9d4aadb4ad5667d2b.jpg not downloaded yet
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_6659d6559462d4c0a3c791c318847a41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_6659d6559462d4c0a3c791c318847a41.jpg not downloaded yet
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_6ebd2a03ed95975d0511de9b2d613076.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_071b6b7e167f328f31d6653ef79b511f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_071b6b7e167f328f31d6653ef79b511f.jpg not downloaded yet
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_358e83d3742f7a1f684b6273f0ccfee8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_358e83d3742f7a1f684b6273f0ccfee8.jpg not downloaded yet
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_09134894c6a75c597627916a5c1a4a31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_09134894c6a75c597627916a5c1a4a31.jpg not downloaded yet
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c39d0>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_2abd7972816e1f5e62aefbfd0f5e3e73.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_2abd7972816e1f5e62aefbfd0f5e3e73.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_83f21bf868eb9ebb760f42a53bb85b3f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_c075b2b5563e558d778d9fbacf9e3675.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_c075b2b5563e558d778d9fbacf9e3675.jpg not downloaded yet
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_746285ce5abb4995dd3e1f3033d1cbc8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_746285ce5abb4995dd3e1f3033d1cbc8.jpg not downloaded yet
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_94eae8ad8cc46f1fa5d279d9c12fc3d1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_94eae8ad8cc46f1fa5d279d9c12fc3d1.jpg not downloaded yet
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f42fe268c6d277f68c696907416945f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_a07630f8ac4ba00ff05192a7fd834c90.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_a07630f8ac4ba00ff05192a7fd834c90.jpg not downloaded yet
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL40281> (referer: https://www.auto1.com/v1/car-details-view/GL40281/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be80f50>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_5f773a18072b12f21ddcd84386d972f0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_5f773a18072b12f21ddcd84386d972f0.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_0998045d97bff5d83a121b65bb48aa5c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_50c9b9cf37b29179a9a28a2cf9a6825f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_52066a4d9b8c641f58796c70e5a6e1e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_52066a4d9b8c641f58796c70e5a6e1e5.jpg not downloaded yet
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd4ebd0>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_6ebd2a03ed95975d0511de9b2d613076.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_6ebd2a03ed95975d0511de9b2d613076.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b029490>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_83f21bf868eb9ebb760f42a53bb85b3f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_83f21bf868eb9ebb760f42a53bb85b3f.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_5878e5b94f73da5391e0659ae6b57300.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_a7be9c31eed22e841e4ccad2b877c266.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_a7be9c31eed22e841e4ccad2b877c266.jpg not downloaded yet
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HF13996> (referer: https://www.auto1.com/v1/car-details-view/HF13996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_394ec227ff402f2de63911b6efed81f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CA87929> (referer: https://www.auto1.com/v1/car-details-view/CA87929/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf7bd0>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_f42fe268c6d277f68c696907416945f7.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f42fe268c6d277f68c696907416945f7.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with identifier: GL40281
2026-03-28 18:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with scrape type 1
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_3acc5035e67473f7a2ed1b45c43302f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_3acc5035e67473f7a2ed1b45c43302f4.jpg not downloaded yet
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb22950>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_0998045d97bff5d83a121b65bb48aa5c.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_0998045d97bff5d83a121b65bb48aa5c.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b01b510>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_50c9b9cf37b29179a9a28a2cf9a6825f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_50c9b9cf37b29179a9a28a2cf9a6825f.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_3d9c2f3e1536592a6920305239304b87.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_a701c197530b3c290a8f60b83a6df388.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_a701c197530b3c290a8f60b83a6df388.jpg not downloaded yet
2026-03-28 18:42:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_6659d6559462d4c0a3c791c318847a41.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_01b2721fe6995df82f7f129cec3f6680.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_01b2721fe6995df82f7f129cec3f6680.jpg not downloaded yet
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b245610>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_5878e5b94f73da5391e0659ae6b57300.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_5878e5b94f73da5391e0659ae6b57300.jpg saved to cache
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5e7d014-69c3-5857-90fb-6d64089f697a with identifier: HF13996
2026-03-28 18:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5e7d014-69c3-5857-90fb-6d64089f697a with scrape type 1
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a5e7d014-69c3-5857-90fb-6d64089f697a
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_f560f0d56abfeca97701b9e1006e8ed7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_f560f0d56abfeca97701b9e1006e8ed7.jpg not downloaded yet
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdfb2d0>
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_394ec227ff402f2de63911b6efed81f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_394ec227ff402f2de63911b6efed81f2.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e
2026-03-28 18:42:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2240651-c63f-55af-b924-8919e49ef1ce with identifier: CA87929
2026-03-28 18:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2240651-c63f-55af-b924-8919e49ef1ce with scrape type 1
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c2240651-c63f-55af-b924-8919e49ef1ce
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_b3c67bfdcfdc7c78afcb1cb7d2514ba9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_b3c67bfdcfdc7c78afcb1cb7d2514ba9.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_cecd96bebb00ce93682ec5fb2ef862f1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_cecd96bebb00ce93682ec5fb2ef862f1.jpg not downloaded yet
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_071b6b7e167f328f31d6653ef79b511f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_94eae8ad8cc46f1fa5d279d9c12fc3d1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_c075b2b5563e558d778d9fbacf9e3675.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_905a103fdd37cdb5d93a216a67a5b82a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_905a103fdd37cdb5d93a216a67a5b82a.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_647daba208b3d89ab92c8ba3803ae5e2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_647daba208b3d89ab92c8ba3803ae5e2.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_ca3ac878935fae0d66b4594432ea9413.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_ca3ac878935fae0d66b4594432ea9413.jpg not downloaded yet
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc5ed90>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_3d9c2f3e1536592a6920305239304b87.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_3d9c2f3e1536592a6920305239304b87.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7c950>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_6659d6559462d4c0a3c791c318847a41.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_6659d6559462d4c0a3c791c318847a41.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_9346468d66995e36334cfaec7b47ee50.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_9346468d66995e36334cfaec7b47ee50.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_359ba583bded099a7972f3c9c8f969e0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_359ba583bded099a7972f3c9c8f969e0.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_35dc10a8895d76397159e2ae85fe6d7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_35dc10a8895d76397159e2ae85fe6d7c.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_c13f018ba6f574e2bac1ed331a5b8481.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_c13f018ba6f574e2bac1ed331a5b8481.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_30768285274b53d344e39ded4cebc20e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_30768285274b53d344e39ded4cebc20e.jpg not downloaded yet
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda5e50>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_071b6b7e167f328f31d6653ef79b511f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_071b6b7e167f328f31d6653ef79b511f.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b041c10>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_94eae8ad8cc46f1fa5d279d9c12fc3d1.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_94eae8ad8cc46f1fa5d279d9c12fc3d1.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16e710>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_c075b2b5563e558d778d9fbacf9e3675.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_c075b2b5563e558d778d9fbacf9e3675.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_a07630f8ac4ba00ff05192a7fd834c90.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_52066a4d9b8c641f58796c70e5a6e1e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_64246fc27a0f2cb5a9a20d8e3b9bd6ce.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_64246fc27a0f2cb5a9a20d8e3b9bd6ce.jpg not downloaded yet
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_a110f8f216508a9b5df78577187c3777.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_6de2fee8ef28f63be0a7b90ac852804d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_6de2fee8ef28f63be0a7b90ac852804d.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_cc93eba0f1e997b785376122e88e5423.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_cc93eba0f1e997b785376122e88e5423.jpg not downloaded yet
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_4c1b2183af2dbcdf2f53568edce18885.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_4c1b2183af2dbcdf2f53568edce18885.jpg not downloaded yet
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_746285ce5abb4995dd3e1f3033d1cbc8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_c415ae2d74db2f1494d2ba69ea2b0f67.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_a7be9c31eed22e841e4ccad2b877c266.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_09134894c6a75c597627916a5c1a4a31.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_403089c0c8b1faf9728307048a5eca98.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_403089c0c8b1faf9728307048a5eca98.jpg not downloaded yet
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_1ea1d217981cfb033fe91da5763c0f2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_4aabe408ec7365bf025f5c20f765b5eb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_4aabe408ec7365bf025f5c20f765b5eb.jpg not downloaded yet
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_d0829320681dfcc26e54d507d5406b71.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b18a390>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_a07630f8ac4ba00ff05192a7fd834c90.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_a07630f8ac4ba00ff05192a7fd834c90.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beaf390>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_52066a4d9b8c641f58796c70e5a6e1e5.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_52066a4d9b8c641f58796c70e5a6e1e5.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_87a6674638215cfa31cda6d8714987df.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59caa310>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_a110f8f216508a9b5df78577187c3777.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_a110f8f216508a9b5df78577187c3777.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_7a880b4a9f7104e9d4aadb4ad5667d2b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_f560f0d56abfeca97701b9e1006e8ed7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_cecd96bebb00ce93682ec5fb2ef862f1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_358e83d3742f7a1f684b6273f0ccfee8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_b3c67bfdcfdc7c78afcb1cb7d2514ba9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda1210>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_746285ce5abb4995dd3e1f3033d1cbc8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_746285ce5abb4995dd3e1f3033d1cbc8.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d533799-fed8-5b1e-b969-134338c744db
2026-03-28 18:42:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beb0c10>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_c415ae2d74db2f1494d2ba69ea2b0f67.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_c415ae2d74db2f1494d2ba69ea2b0f67.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7e2d0>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_a7be9c31eed22e841e4ccad2b877c266.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_a7be9c31eed22e841e4ccad2b877c266.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beffe10>
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252Fc4%252F7bc468b3f8211e785f4f9bf4f9e364a7%252Fpa%252FFJ78997_09134894c6a75c597627916a5c1a4a31.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_09134894c6a75c597627916a5c1a4a31.jpg saved to cache
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e
2026-03-28 18:42:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e, skipping ID generation
2026-03-28 18:42:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with scrape type 1
2026-03-28 18:42:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e sending to next pipeline
2026-03-28 18:42:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e, identifier: FJ78997
2026-03-28 18:42:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda1a50>
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_1ea1d217981cfb033fe91da5763c0f2a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_1ea1d217981cfb033fe91da5763c0f2a.jpg saved to cache
2026-03-28 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bde4a50>
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_d0829320681dfcc26e54d507d5406b71.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_d0829320681dfcc26e54d507d5406b71.jpg saved to cache
2026-03-28 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb02510>
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_87a6674638215cfa31cda6d8714987df.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_87a6674638215cfa31cda6d8714987df.jpg saved to cache
2026-03-28 18:42:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with identifier: FJ78997
2026-03-28 18:42:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with identifier: FJ78997
2026-03-28 18:42:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ca2b60b-61bf-5afe-b36e-b84c3dfe670e with identifier: FJ78997 to the API
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_09134894c6a75c597627916a5c1a4a31.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:36:58Z',
 'fuel_type': 'petrol',
 'id': '8ca2b60b-61bf-5afe-b36e-b84c3dfe670e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ78997',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'BMW',
 'model': '1er',
 'odometer': 119007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_394ec227ff402f2de63911b6efed81f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_3d9c2f3e1536592a6920305239304b87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_6659d6559462d4c0a3c791c318847a41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76825,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_09134894c6a75c597627916a5c1a4a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ca2b60b-61bf-5afe-b36e-b84c3dfe670e/8ca2b60b-61bf-5afe-b36e-b84c3dfe670e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/c4/7bc468b3f8211e785f4f9bf4f9e364a7/pa/FJ78997_94eae8ad8cc46f1fa5d279d9c12fc3d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-05-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78997%27 HTTP/1.1" 200 None
2026-03-28 18:42:32 [auto1.de] INFO: Saving data for FJ78997: {'created_time': 1774723352.417159, 'last_price_update_time': 1774723352.417171, 'auction_closing_time': 1774885018.0}
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ78997') HTTP/1.1" 204 0
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_359ba583bded099a7972f3c9c8f969e0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_cc93eba0f1e997b785376122e88e5423.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b187690>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_7a880b4a9f7104e9d4aadb4ad5667d2b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_7a880b4a9f7104e9d4aadb4ad5667d2b.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d533799-fed8-5b1e-b969-134338c744db
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0e790>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_f560f0d56abfeca97701b9e1006e8ed7.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_f560f0d56abfeca97701b9e1006e8ed7.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5e7d014-69c3-5857-90fb-6d64089f697a
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be78c90>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_cecd96bebb00ce93682ec5fb2ef862f1.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_cecd96bebb00ce93682ec5fb2ef862f1.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda0650>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_358e83d3742f7a1f684b6273f0ccfee8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_358e83d3742f7a1f684b6273f0ccfee8.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d533799-fed8-5b1e-b969-134338c744db
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26fed0>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_b3c67bfdcfdc7c78afcb1cb7d2514ba9.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_b3c67bfdcfdc7c78afcb1cb7d2514ba9.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c2240651-c63f-55af-b924-8919e49ef1ce
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fdcb50>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_359ba583bded099a7972f3c9c8f969e0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_359ba583bded099a7972f3c9c8f969e0.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c2240651-c63f-55af-b924-8919e49ef1ce
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdfb710>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_cc93eba0f1e997b785376122e88e5423.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_cc93eba0f1e997b785376122e88e5423.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c2240651-c63f-55af-b924-8919e49ef1ce
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_30768285274b53d344e39ded4cebc20e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_6de2fee8ef28f63be0a7b90ac852804d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_3acc5035e67473f7a2ed1b45c43302f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_35dc10a8895d76397159e2ae85fe6d7c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_64246fc27a0f2cb5a9a20d8e3b9bd6ce.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_9346468d66995e36334cfaec7b47ee50.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_c13f018ba6f574e2bac1ed331a5b8481.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_647daba208b3d89ab92c8ba3803ae5e2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb1ad0>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_30768285274b53d344e39ded4cebc20e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_30768285274b53d344e39ded4cebc20e.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c2240651-c63f-55af-b924-8919e49ef1ce
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_4aabe408ec7365bf025f5c20f765b5eb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_905a103fdd37cdb5d93a216a67a5b82a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_4c1b2183af2dbcdf2f53568edce18885.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb3dc50>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_6de2fee8ef28f63be0a7b90ac852804d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_6de2fee8ef28f63be0a7b90ac852804d.jpg saved to cache
2026-03-28 18:42:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5e7d014-69c3-5857-90fb-6d64089f697a
2026-03-28 18:42:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a5290>
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_3acc5035e67473f7a2ed1b45c43302f4.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_3acc5035e67473f7a2ed1b45c43302f4.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2441d0>
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_35dc10a8895d76397159e2ae85fe6d7c.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_35dc10a8895d76397159e2ae85fe6d7c.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b150910>
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_64246fc27a0f2cb5a9a20d8e3b9bd6ce.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_64246fc27a0f2cb5a9a20d8e3b9bd6ce.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_403089c0c8b1faf9728307048a5eca98.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_87906f7bb56a0881c8b1d5397dd619fe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_b40429ee313e6f52f234f85a3a9a8cc9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b245810>
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_9346468d66995e36334cfaec7b47ee50.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_9346468d66995e36334cfaec7b47ee50.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5e7d014-69c3-5857-90fb-6d64089f697a
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd99610>
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_c13f018ba6f574e2bac1ed331a5b8481.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_c13f018ba6f574e2bac1ed331a5b8481.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5e7d014-69c3-5857-90fb-6d64089f697a
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc14990>
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F88%252Fa68864a54c1da13a9c811c577554f06d%252Fpa%252FCA87929_647daba208b3d89ab92c8ba3803ae5e2.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_647daba208b3d89ab92c8ba3803ae5e2.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c2240651-c63f-55af-b924-8919e49ef1ce
2026-03-28 18:42:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c2240651-c63f-55af-b924-8919e49ef1ce, skipping ID generation
2026-03-28 18:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2240651-c63f-55af-b924-8919e49ef1ce with scrape type 1
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c2240651-c63f-55af-b924-8919e49ef1ce sending to next pipeline
2026-03-28 18:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c2240651-c63f-55af-b924-8919e49ef1ce, identifier: CA87929
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd35290>
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_4aabe408ec7365bf025f5c20f765b5eb.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_4aabe408ec7365bf025f5c20f765b5eb.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b183290>
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F69%252Fdf694b9a8f0fffd493f4af4e0af3c9b3%252Fpa%252FHF13996_905a103fdd37cdb5d93a216a67a5b82a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_905a103fdd37cdb5d93a216a67a5b82a.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5e7d014-69c3-5857-90fb-6d64089f697a
2026-03-28 18:42:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5e7d014-69c3-5857-90fb-6d64089f697a, skipping ID generation
2026-03-28 18:42:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5e7d014-69c3-5857-90fb-6d64089f697a with scrape type 1
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5e7d014-69c3-5857-90fb-6d64089f697a sending to next pipeline
2026-03-28 18:42:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5e7d014-69c3-5857-90fb-6d64089f697a, identifier: HF13996
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59caa750>
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_4c1b2183af2dbcdf2f53568edce18885.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_4c1b2183af2dbcdf2f53568edce18885.jpg saved to cache
2026-03-28 18:42:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c2240651-c63f-55af-b924-8919e49ef1ce with identifier: CA87929
2026-03-28 18:42:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c2240651-c63f-55af-b924-8919e49ef1ce with identifier: CA87929
2026-03-28 18:42:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c2240651-c63f-55af-b924-8919e49ef1ce with identifier: CA87929 to the API
2026-03-28 18:42:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_647daba208b3d89ab92c8ba3803ae5e2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:27:34Z',
 'fuel_type': 'petrol',
 'id': 'c2240651-c63f-55af-b924-8919e49ef1ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA87929',
 'listing': 'auction',
 'location': 'DE, Jena',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 187588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_b3c67bfdcfdc7c78afcb1cb7d2514ba9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_647daba208b3d89ab92c8ba3803ae5e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_359ba583bded099a7972f3c9c8f969e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_30768285274b53d344e39ded4cebc20e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c2240651-c63f-55af-b924-8919e49ef1ce/c2240651-c63f-55af-b924-8919e49ef1ce_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130085,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/88/a68864a54c1da13a9c811c577554f06d/pa/CA87929_cc93eba0f1e997b785376122e88e5423.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2010}
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA87929%27 HTTP/1.1" 200 None
2026-03-28 18:42:34 [auto1.de] INFO: Saving data for CA87929: {'created_time': 1774723354.145926, 'last_price_update_time': 1774723354.14594, 'auction_closing_time': 1774884454.0}
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA87929') HTTP/1.1" 204 0
2026-03-28 18:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5e7d014-69c3-5857-90fb-6d64089f697a with identifier: HF13996
2026-03-28 18:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5e7d014-69c3-5857-90fb-6d64089f697a with identifier: HF13996
2026-03-28 18:42:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5e7d014-69c3-5857-90fb-6d64089f697a with identifier: HF13996 to the API
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_905a103fdd37cdb5d93a216a67a5b82a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:38:19Z',
 'fuel_type': 'petrol',
 'id': 'a5e7d014-69c3-5857-90fb-6d64089f697a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF13996',
 'listing': 'auction',
 'location': 'DE, Lübeck',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 186762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_f560f0d56abfeca97701b9e1006e8ed7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_905a103fdd37cdb5d93a216a67a5b82a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_9346468d66995e36334cfaec7b47ee50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76949,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_c13f018ba6f574e2bac1ed331a5b8481.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5e7d014-69c3-5857-90fb-6d64089f697a/a5e7d014-69c3-5857-90fb-6d64089f697a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96665,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/69/df694b9a8f0fffd493f4af4e0af3c9b3/pa/HF13996_6de2fee8ef28f63be0a7b90ac852804d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-10-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Grand Filou Cool',
 'transmission': 'manual',
 'trim': 'Grand Filou Cool',
 'year': 2007}
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF13996%27 HTTP/1.1" 200 None
2026-03-28 18:42:34 [auto1.de] INFO: Saving data for HF13996: {'created_time': 1774723354.557125, 'last_price_update_time': 1774723354.557137, 'auction_closing_time': 1774885099.0}
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HF13996') HTTP/1.1" 204 0
2026-03-28 18:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_9fb44a22df1b75b84268aafc0e5514c2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_f1d5f019f5d686852c405ec38dbad2c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_2a19672e3f2313a89001359bc13d9983.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_f4e60fc797931af7a2db5fb726ba57ae.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd83710>
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_403089c0c8b1faf9728307048a5eca98.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_403089c0c8b1faf9728307048a5eca98.jpg saved to cache
2026-03-28 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b025990>
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg80%252F70%252F80704dab4d5b4667ec969f43ee7290a8%252Fpa%252FZZ30319_87906f7bb56a0881c8b1d5397dd619fe.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_87906f7bb56a0881c8b1d5397dd619fe.jpg saved to cache
2026-03-28 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda
2026-03-28 18:42:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda, skipping ID generation
2026-03-28 18:42:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with scrape type 1
2026-03-28 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6e19cca-5226-5d25-8fc3-35cc9bc6dcda sending to next pipeline
2026-03-28 18:42:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda, identifier: ZZ30319
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2aafd0>
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_b40429ee313e6f52f234f85a3a9a8cc9.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_b40429ee313e6f52f234f85a3a9a8cc9.jpg saved to cache
2026-03-28 18:42:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d533799-fed8-5b1e-b969-134338c744db
2026-03-28 18:42:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with identifier: ZZ30319
2026-03-28 18:42:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with identifier: ZZ30319
2026-03-28 18:42:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6e19cca-5226-5d25-8fc3-35cc9bc6dcda with identifier: ZZ30319 to the API
2026-03-28 18:42:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_87906f7bb56a0881c8b1d5397dd619fe.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:31:27Z',
 'fuel_type': 'petrol',
 'id': 'b6e19cca-5226-5d25-8fc3-35cc9bc6dcda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ30319',
 'listing': 'auction',
 'location': 'DE, Kumhausen',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 250708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_87906f7bb56a0881c8b1d5397dd619fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_071b6b7e167f328f31d6653ef79b511f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_c075b2b5563e558d778d9fbacf9e3675.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84898,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_a07630f8ac4ba00ff05192a7fd834c90.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_52066a4d9b8c641f58796c70e5a6e1e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6e19cca-5226-5d25-8fc3-35cc9bc6dcda/b6e19cca-5226-5d25-8fc3-35cc9bc6dcda_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img80/70/80704dab4d5b4667ec969f43ee7290a8/pa/ZZ30319_a7be9c31eed22e841e4ccad2b877c266.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ30319%27 HTTP/1.1" 200 None
2026-03-28 18:42:35 [auto1.de] INFO: Saving data for ZZ30319: {'created_time': 1774723355.187847, 'last_price_update_time': 1774723355.187863, 'auction_closing_time': 1774884687.0}
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ30319') HTTP/1.1" 204 0
2026-03-28 18:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_aa5d6f6c6aae105070060fb2871ece0d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_3fca4b43223ed14365991b1e706d3caa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd81cd0>
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_9fb44a22df1b75b84268aafc0e5514c2.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_9fb44a22df1b75b84268aafc0e5514c2.jpg saved to cache
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb04990>
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_f1d5f019f5d686852c405ec38dbad2c4.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_f1d5f019f5d686852c405ec38dbad2c4.jpg saved to cache
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7eed0>
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_2a19672e3f2313a89001359bc13d9983.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_2a19672e3f2313a89001359bc13d9983.jpg saved to cache
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd9a250>
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc1%252F83%252Fc183a84e8a0b203151a5229fafa25a83%252Fpa%252FNG57043_f4e60fc797931af7a2db5fb726ba57ae.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_f4e60fc797931af7a2db5fb726ba57ae.jpg saved to cache
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d533799-fed8-5b1e-b969-134338c744db
2026-03-28 18:42:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d533799-fed8-5b1e-b969-134338c744db, skipping ID generation
2026-03-28 18:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d533799-fed8-5b1e-b969-134338c744db with scrape type 1
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d533799-fed8-5b1e-b969-134338c744db sending to next pipeline
2026-03-28 18:42:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d533799-fed8-5b1e-b969-134338c744db, identifier: NG57043
2026-03-28 18:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_7bce5832a9a2b82d1f7c24dfc8bbf785.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d533799-fed8-5b1e-b969-134338c744db with identifier: NG57043
2026-03-28 18:42:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d533799-fed8-5b1e-b969-134338c744db with identifier: NG57043
2026-03-28 18:42:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d533799-fed8-5b1e-b969-134338c744db with identifier: NG57043 to the API
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_f4e60fc797931af7a2db5fb726ba57ae.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:18:55Z',
 'fuel_type': 'petrol',
 'id': '4d533799-fed8-5b1e-b969-134338c744db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG57043',
 'listing': 'auction',
 'location': 'DE, Böblingen',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 68963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_f4e60fc797931af7a2db5fb726ba57ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_b40429ee313e6f52f234f85a3a9a8cc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_7a880b4a9f7104e9d4aadb4ad5667d2b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_358e83d3742f7a1f684b6273f0ccfee8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d533799-fed8-5b1e-b969-134338c744db/4d533799-fed8-5b1e-b969-134338c744db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 135026,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc1/83/c183a84e8a0b203151a5229fafa25a83/pa/NG57043_746285ce5abb4995dd3e1f3033d1cbc8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Futura',
 'transmission': 'manual',
 'trim': 'Futura',
 'year': 2001}
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG57043%27 HTTP/1.1" 200 None
2026-03-28 18:42:35 [auto1.de] INFO: Saving data for NG57043: {'created_time': 1774723355.879391, 'last_price_update_time': 1774723355.879403, 'auction_closing_time': 1774883935.0}
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG57043') HTTP/1.1" 204 0
2026-03-28 18:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_f72c6fb9cc90edbf5e58af98d6bf803b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_b6611bdf279ced12f112272cc9c9629b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb22d0>
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_aa5d6f6c6aae105070060fb2871ece0d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_aa5d6f6c6aae105070060fb2871ece0d.jpg saved to cache
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb55290>
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_3fca4b43223ed14365991b1e706d3caa.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_3fca4b43223ed14365991b1e706d3caa.jpg saved to cache
2026-03-28 18:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc4ecd0>
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_7bce5832a9a2b82d1f7c24dfc8bbf785.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_7bce5832a9a2b82d1f7c24dfc8bbf785.jpg saved to cache
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b
2026-03-28 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_f31a190bc8336d0b1581c1f252135704.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WC65602> (referer: https://www.auto1.com/v1/car-details-view/WC65602/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF09080> (referer: https://www.auto1.com/v1/car-details-view/FF09080/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VN03026> (referer: https://www.auto1.com/v1/car-details-view/VN03026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2960d0>
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_f72c6fb9cc90edbf5e58af98d6bf803b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_f72c6fb9cc90edbf5e58af98d6bf803b.jpg saved to cache
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be79650>
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F44%252F6b44d73fb9d662c88291785f8ef74d37%252Fpa%252FTV59519_b6611bdf279ced12f112272cc9c9629b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_b6611bdf279ced12f112272cc9c9629b.jpg saved to cache
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b
2026-03-28 18:42:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b, skipping ID generation
2026-03-28 18:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with scrape type 1
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b sending to next pipeline
2026-03-28 18:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b, identifier: TV59519
2026-03-28 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_1134c4151fd26542272a14bfaaddf042.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_3d27bd77eb547ed3960c1740c39e631f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with identifier: TV59519
2026-03-28 18:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with identifier: TV59519
2026-03-28 18:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b with identifier: TV59519 to the API
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_b6611bdf279ced12f112272cc9c9629b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:38:29Z',
 'fuel_type': 'diesel',
 'id': '2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV59519',
 'listing': 'auction',
 'location': 'DE, Rosenheim',
 'make': 'Citroen',
 'model': 'C4 Picasso',
 'odometer': 217579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_b6611bdf279ced12f112272cc9c9629b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_446a40275044991664bc4aa3d25e4ee8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_7bce5832a9a2b82d1f7c24dfc8bbf785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_f1d5f019f5d686852c405ec38dbad2c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_83f21bf868eb9ebb760f42a53bb85b3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b/2f91d04e-6c57-57d6-9bb8-a76f4c25ca0b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/44/6b44d73fb9d662c88291785f8ef74d37/pa/TV59519_50c9b9cf37b29179a9a28a2cf9a6825f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C4 Picasso 1.6 e-HDi Intensive',
 'transmission': 'automatic',
 'trim': 'Intensive',
 'year': 2013}
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV59519%27 HTTP/1.1" 200 None
2026-03-28 18:42:36 [auto1.de] INFO: Saving data for TV59519: {'created_time': 1774723356.729914, 'last_price_update_time': 1774723356.729927, 'auction_closing_time': 1774885109.0}
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV59519') HTTP/1.1" 204 0
2026-03-28 18:42:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_887ca953f672a55c14ae4a13950bda00.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b212710>
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_f31a190bc8336d0b1581c1f252135704.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_f31a190bc8336d0b1581c1f252135704.jpg saved to cache
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db665ca2-fa02-5c51-b61d-83e72285554d with identifier: WC65602
2026-03-28 18:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db665ca2-fa02-5c51-b61d-83e72285554d with scrape type 1
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_09bc3ee5c462e2a5927684d950aa5ea9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_09bc3ee5c462e2a5927684d950aa5ea9.jpg not downloaded yet
2026-03-28 18:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19680ba3-d4ba-53c6-917f-d68876343700 with identifier: FF09080
2026-03-28 18:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19680ba3-d4ba-53c6-917f-d68876343700 with scrape type 1
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 19680ba3-d4ba-53c6-917f-d68876343700
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_d01b64cbbbe0a28f5c51bba61fc8ad9f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_d01b64cbbbe0a28f5c51bba61fc8ad9f.jpg not downloaded yet
2026-03-28 18:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 266a0dea-d422-56c1-ab95-c86f1b0caac2 with identifier: VN03026
2026-03-28 18:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 266a0dea-d422-56c1-ab95-c86f1b0caac2 with scrape type 1
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 266a0dea-d422-56c1-ab95-c86f1b0caac2
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F16%252F94166c297cdd70a2165fad11ad72c3f9%252Fpa%252FVN03026_806a2b28b996908bdcf203eef4e0e464.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_806a2b28b996908bdcf203eef4e0e464.jpg already downloaded
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F16%252F94166c297cdd70a2165fad11ad72c3f9%252Fpa%252FVN03026_45b7dd2416d210395e86953ff185178d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_45b7dd2416d210395e86953ff185178d.jpg already downloaded
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F16%252F94166c297cdd70a2165fad11ad72c3f9%252Fpa%252FVN03026_6fc33bc6f66bbe7774661d7693eba3ac.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_6fc33bc6f66bbe7774661d7693eba3ac.jpg already downloaded
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F16%252F94166c297cdd70a2165fad11ad72c3f9%252Fpa%252FVN03026_6290eb9e5c42cad1bd9396bce50ea3c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_6290eb9e5c42cad1bd9396bce50ea3c8.jpg already downloaded
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F16%252F94166c297cdd70a2165fad11ad72c3f9%252Fpa%252FVN03026_5bf597ef30df085a0554ce26fc2cda73.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_5bf597ef30df085a0554ce26fc2cda73.jpg already downloaded
2026-03-28 18:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 266a0dea-d422-56c1-ab95-c86f1b0caac2, identifier: VN03026
2026-03-28 18:42:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a6590>
2026-03-28 18:42:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg72%252F2c%252F722cc774e51c44b1537bbef635eaccb2%252Fpa%252FVL24807_1134c4151fd26542272a14bfaaddf042.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_1134c4151fd26542272a14bfaaddf042.jpg saved to cache
2026-03-28 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5710373-7d5f-5f2c-9026-e234d39ef950
2026-03-28 18:42:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5710373-7d5f-5f2c-9026-e234d39ef950, skipping ID generation
2026-03-28 18:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5710373-7d5f-5f2c-9026-e234d39ef950 with scrape type 1
2026-03-28 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5710373-7d5f-5f2c-9026-e234d39ef950 sending to next pipeline
2026-03-28 18:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5710373-7d5f-5f2c-9026-e234d39ef950, identifier: VL24807
2026-03-28 18:42:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb034d0>
2026-03-28 18:42:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252Fd4%252F3bd438e6364ebe06929339aae12c8456%252Fpa%252FZA82087_3d27bd77eb547ed3960c1740c39e631f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_3d27bd77eb547ed3960c1740c39e631f.jpg saved to cache
2026-03-28 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca
2026-03-28 18:42:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca, skipping ID generation
2026-03-28 18:42:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with scrape type 1
2026-03-28 18:42:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 672dea5c-fd7b-5e30-a78a-f2b09ea808ca sending to next pipeline
2026-03-28 18:42:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca, identifier: ZA82087
2026-03-28 18:42:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 266a0dea-d422-56c1-ab95-c86f1b0caac2 with identifier: VN03026
2026-03-28 18:42:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 266a0dea-d422-56c1-ab95-c86f1b0caac2 with identifier: VN03026
2026-03-28 18:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 266a0dea-d422-56c1-ab95-c86f1b0caac2 with identifier: VN03026 to the API
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VN03026>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:06Z',
 'fuel_type': 'petrol',
 'id': '266a0dea-d422-56c1-ab95-c86f1b0caac2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN03026',
 'listing': 'auction',
 'location': 'Montabaur',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 107933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_806a2b28b996908bdcf203eef4e0e464.jpg',
                'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_45b7dd2416d210395e86953ff185178d.jpg',
                'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_6fc33bc6f66bbe7774661d7693eba3ac.jpg',
                'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_6290eb9e5c42cad1bd9396bce50ea3c8.jpg',
                'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_5bf597ef30df085a0554ce26fc2cda73.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266a0dea-d422-56c1-ab95-c86f1b0caac2/266a0dea-d422-56c1-ab95-c86f1b0caac2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_806a2b28b996908bdcf203eef4e0e464.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266a0dea-d422-56c1-ab95-c86f1b0caac2/266a0dea-d422-56c1-ab95-c86f1b0caac2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78478,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_45b7dd2416d210395e86953ff185178d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266a0dea-d422-56c1-ab95-c86f1b0caac2/266a0dea-d422-56c1-ab95-c86f1b0caac2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71746,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_6fc33bc6f66bbe7774661d7693eba3ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266a0dea-d422-56c1-ab95-c86f1b0caac2/266a0dea-d422-56c1-ab95-c86f1b0caac2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_6290eb9e5c42cad1bd9396bce50ea3c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_266a0dea-d422-56c1-ab95-c86f1b0caac2/266a0dea-d422-56c1-ab95-c86f1b0caac2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88081,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/16/94166c297cdd70a2165fad11ad72c3f9/pa/VN03026_5bf597ef30df085a0554ce26fc2cda73.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-04-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2009}
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN03026%27 HTTP/1.1" 200 None
2026-03-28 18:42:37 [auto1.de] INFO: Saving data for VN03026: {'created_time': 1774723357.673356, 'last_price_update_time': 1774723357.673367, 'auction_closing_time': 1774883826.0}
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN03026') HTTP/1.1" 204 0
2026-03-28 18:42:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5710373-7d5f-5f2c-9026-e234d39ef950 with identifier: VL24807
2026-03-28 18:42:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5710373-7d5f-5f2c-9026-e234d39ef950 with identifier: VL24807
2026-03-28 18:42:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5710373-7d5f-5f2c-9026-e234d39ef950 with identifier: VL24807 to the API
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_1134c4151fd26542272a14bfaaddf042.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.9L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:17:09Z',
 'fuel_type': 'petrol',
 'id': 'f5710373-7d5f-5f2c-9026-e234d39ef950',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL24807',
 'listing': 'auction',
 'location': 'DE, Eisenach',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 89748,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_1134c4151fd26542272a14bfaaddf042.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_bf730399088667646733dbb9f7a37304.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_3fb4acb1342c6a4a8e293997f90d1ef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2458071,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_c415ae2d74db2f1494d2ba69ea2b0f67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2423325,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_a110f8f216508a9b5df78577187c3777.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_f72c6fb9cc90edbf5e58af98d6bf803b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_2abd7972816e1f5e62aefbfd0f5e3e73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2498343,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_d0829320681dfcc26e54d507d5406b71.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_aa5d6f6c6aae105070060fb2871ece0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5710373-7d5f-5f2c-9026-e234d39ef950/f5710373-7d5f-5f2c-9026-e234d39ef950_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img72/2c/722cc774e51c44b1537bbef635eaccb2/pa/VL24807_5f773a18072b12f21ddcd84386d972f0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL24807%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Saving data for VL24807: {'created_time': 1774723358.119605, 'last_price_update_time': 1774723358.119617, 'auction_closing_time': 1774883829.0}
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL24807') HTTP/1.1" 204 0
2026-03-28 18:42:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with identifier: ZA82087
2026-03-28 18:42:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with identifier: ZA82087
2026-03-28 18:42:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 672dea5c-fd7b-5e30-a78a-f2b09ea808ca with identifier: ZA82087 to the API
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_3d27bd77eb547ed3960c1740c39e631f.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:39:33Z',
 'fuel_type': 'petrol',
 'id': '672dea5c-fd7b-5e30-a78a-f2b09ea808ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA82087',
 'listing': 'auction',
 'location': 'DE, Hamburg',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 116565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91454,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_3d27bd77eb547ed3960c1740c39e631f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95086,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_69932ce3629eee105668d5a25c4a3550.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_c3dc6c8466437f4099b761ceb52b8e0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_ef7a18d05ef832070bd3a66731c0983b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_672dea5c-fd7b-5e30-a78a-f2b09ea808ca/672dea5c-fd7b-5e30-a78a-f2b09ea808ca_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/d4/3bd438e6364ebe06929339aae12c8456/pa/ZA82087_86b9d843c301534a47e2c009673cf3df.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-01-03',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2008}
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA82087%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [auto1.de] INFO: Saving data for ZA82087: {'created_time': 1774723358.570112, 'last_price_update_time': 1774723358.570123, 'auction_closing_time': 1774885173.0}
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA82087') HTTP/1.1" 204 0
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_6bcc970f3d32cf67f562feb0ee99fb2f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_6bcc970f3d32cf67f562feb0ee99fb2f.jpg not downloaded yet
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_08a12f4d9dde1b03b88520454bf4ad89.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_08a12f4d9dde1b03b88520454bf4ad89.jpg not downloaded yet
2026-03-28 18:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_3b24e74768e9264cc24ac34d3fc82d81.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_98ddbe987028a42d2c1f06f3bc86c237.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_2fdc0ee3cb4e7851d93f23ce1b5da1ab.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b01bc10>
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_887ca953f672a55c14ae4a13950bda00.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_887ca953f672a55c14ae4a13950bda00.jpg saved to cache
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_cd240493f21730feceb9059c9eb01e42.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_cd240493f21730feceb9059c9eb01e42.jpg not downloaded yet
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_9f873e3f49bd7991f2ebb8ad26755649.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_9f873e3f49bd7991f2ebb8ad26755649.jpg not downloaded yet
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_3315bc4588558bbe9ec741baa8d507bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_3315bc4588558bbe9ec741baa8d507bf.jpg not downloaded yet
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_c9e61e96fa4b2706a9318dbf1a8518ad.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_c9e61e96fa4b2706a9318dbf1a8518ad.jpg not downloaded yet
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_debe277c1e2fe1aaee1ff268fe930095.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_debe277c1e2fe1aaee1ff268fe930095.jpg not downloaded yet
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_30260d5272802ddc4fb67f979d38a0bf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_30260d5272802ddc4fb67f979d38a0bf.jpg not downloaded yet
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_ac2202187d3e7df221754edcabf705c0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_ac2202187d3e7df221754edcabf705c0.jpg not downloaded yet
2026-03-28 18:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_0789cbffa75c3e8651b89a84383f024c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc15fd0>
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_3b24e74768e9264cc24ac34d3fc82d81.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_3b24e74768e9264cc24ac34d3fc82d81.jpg saved to cache
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc4db10>
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_98ddbe987028a42d2c1f06f3bc86c237.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_98ddbe987028a42d2c1f06f3bc86c237.jpg saved to cache
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1139d0>
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F6c%252Fa76ca40f38de9055b6ab0b7138a89b70%252Fpa%252FKT60539_2fdc0ee3cb4e7851d93f23ce1b5da1ab.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_2fdc0ee3cb4e7851d93f23ce1b5da1ab.jpg saved to cache
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13fe999f-d980-5b0c-918f-8c224e9e66ac
2026-03-28 18:42:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13fe999f-d980-5b0c-918f-8c224e9e66ac, skipping ID generation
2026-03-28 18:42:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13fe999f-d980-5b0c-918f-8c224e9e66ac with scrape type 1
2026-03-28 18:42:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13fe999f-d980-5b0c-918f-8c224e9e66ac sending to next pipeline
2026-03-28 18:42:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13fe999f-d980-5b0c-918f-8c224e9e66ac, identifier: KT60539
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_1264249c5ac1178a2a034c0ee6b5073b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_1264249c5ac1178a2a034c0ee6b5073b.jpg not downloaded yet
2026-03-28 18:42:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13fe999f-d980-5b0c-918f-8c224e9e66ac with identifier: KT60539
2026-03-28 18:42:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13fe999f-d980-5b0c-918f-8c224e9e66ac with identifier: KT60539
2026-03-28 18:42:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13fe999f-d980-5b0c-918f-8c224e9e66ac with identifier: KT60539 to the API
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_2fdc0ee3cb4e7851d93f23ce1b5da1ab.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:13:09Z',
 'fuel_type': 'petrol',
 'id': '13fe999f-d980-5b0c-918f-8c224e9e66ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT60539',
 'listing': 'auction',
 'location': 'DE, Gießen',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 94822,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_ca2c11886fea88bbb3a8457116c788dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87004,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_0769e12b6d1b681f1e2fb5cb0810dc66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82064,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_826d6af49105e1b6cc0941a9eec904b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_98ddbe987028a42d2c1f06f3bc86c237.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3587993,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_1ea1d217981cfb033fe91da5763c0f2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_2fdc0ee3cb4e7851d93f23ce1b5da1ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_3b24e74768e9264cc24ac34d3fc82d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_887ca953f672a55c14ae4a13950bda00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_f31a190bc8336d0b1581c1f252135704.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13fe999f-d980-5b0c-918f-8c224e9e66ac/13fe999f-d980-5b0c-918f-8c224e9e66ac_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/6c/a76ca40f38de9055b6ab0b7138a89b70/pa/KT60539_5d77c5feb6d8edaadd69b5e5bf0e0a8a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.2 TSI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT60539%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [auto1.de] INFO: Saving data for KT60539: {'created_time': 1774723359.405121, 'last_price_update_time': 1774723359.405133, 'auction_closing_time': 1774883589.0}
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KT60539') HTTP/1.1" 204 0
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_61c56383d946c81361db6292b4165695.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_20a8a5b0bc7193b4c8f8f5bdbfcadc7d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_974a85b0bda8cbf236314f5c3448bc8e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_8596ca30ec92f4341741db418a3c38af.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_8596ca30ec92f4341741db418a3c38af.jpg not downloaded yet
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_ca3ac878935fae0d66b4594432ea9413.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_104f30706d84b5b8b7fc9e7009194564.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_104f30706d84b5b8b7fc9e7009194564.jpg not downloaded yet
2026-03-28 18:42:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc1e590>
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_0789cbffa75c3e8651b89a84383f024c.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_0789cbffa75c3e8651b89a84383f024c.jpg saved to cache
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_01b2721fe6995df82f7f129cec3f6680.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT32005/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_4377412f70dac315d99a47565e79583d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_6a3f338c0f265f010bf571c52f583601.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_6a3f338c0f265f010bf571c52f583601.jpg not downloaded yet
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_d01b64cbbbe0a28f5c51bba61fc8ad9f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_09bc3ee5c462e2a5927684d950aa5ea9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f15486cf47943fd737642bfa20cc4485.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_0fcf67c66e3f67e2037a165bebc158d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_a701c197530b3c290a8f60b83a6df388.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be930d0>
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_61c56383d946c81361db6292b4165695.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_61c56383d946c81361db6292b4165695.jpg saved to cache
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b027d10>
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_20a8a5b0bc7193b4c8f8f5bdbfcadc7d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_20a8a5b0bc7193b4c8f8f5bdbfcadc7d.jpg saved to cache
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b204350>
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_974a85b0bda8cbf236314f5c3448bc8e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_974a85b0bda8cbf236314f5c3448bc8e.jpg saved to cache
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd4fe90>
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_ca3ac878935fae0d66b4594432ea9413.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_ca3ac878935fae0d66b4594432ea9413.jpg saved to cache
2026-03-28 18:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_fcbcf3bf9725b86a98b4c8852ec05017.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_30260d5272802ddc4fb67f979d38a0bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_c9e61e96fa4b2706a9318dbf1a8518ad.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_debe277c1e2fe1aaee1ff268fe930095.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb0a350>
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_01b2721fe6995df82f7f129cec3f6680.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_01b2721fe6995df82f7f129cec3f6680.jpg saved to cache
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:40 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b06b0d0>
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_4377412f70dac315d99a47565e79583d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_4377412f70dac315d99a47565e79583d.jpg saved to cache
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b09ed90>
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_d01b64cbbbe0a28f5c51bba61fc8ad9f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_d01b64cbbbe0a28f5c51bba61fc8ad9f.jpg saved to cache
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19680ba3-d4ba-53c6-917f-d68876343700
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdd9590>
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_09bc3ee5c462e2a5927684d950aa5ea9.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_09bc3ee5c462e2a5927684d950aa5ea9.jpg saved to cache
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b179290>
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F97%252F77976cc7deaaa82862b71df6587680bc%252Fpa%252FXA48872_f15486cf47943fd737642bfa20cc4485.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f15486cf47943fd737642bfa20cc4485.jpg saved to cache
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b
2026-03-28 18:42:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b, skipping ID generation
2026-03-28 18:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with scrape type 1
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a69eac5-d21f-5b7d-b898-a09c3a3a738b sending to next pipeline
2026-03-28 18:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b, identifier: XA48872
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc1fe50>
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252F2b%252F082b08b00b83b328f91cdcb3d0f45844%252Fpa%252FKC60426_0fcf67c66e3f67e2037a165bebc158d3.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_0fcf67c66e3f67e2037a165bebc158d3.jpg saved to cache
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026
2026-03-28 18:42:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026, skipping ID generation
2026-03-28 18:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with scrape type 1
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 sending to next pipeline
2026-03-28 18:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026, identifier: KC60426
2026-03-28 18:42:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd51490>
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdb%252F2c%252Fdb2c8c359846135cd2ca06c98e276880%252Fpa%252FGL40281_a701c197530b3c290a8f60b83a6df388.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_a701c197530b3c290a8f60b83a6df388.jpg saved to cache
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe
2026-03-28 18:42:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe, skipping ID generation
2026-03-28 18:42:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with scrape type 1
2026-03-28 18:42:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e8a1e95-281c-5023-8bba-16c49d8a5cfe sending to next pipeline
2026-03-28 18:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe, identifier: GL40281
2026-03-28 18:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with identifier: XA48872
2026-03-28 18:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with identifier: XA48872
2026-03-28 18:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3a69eac5-d21f-5b7d-b898-a09c3a3a738b with identifier: XA48872 to the API
2026-03-28 18:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f15486cf47943fd737642bfa20cc4485.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:40:14Z',
 'fuel_type': 'petrol',
 'id': '3a69eac5-d21f-5b7d-b898-a09c3a3a738b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA48872',
 'listing': 'auction',
 'location': 'DE, Blankenfelde-Mahlow',
 'make': 'Fiat',
 'model': '500',
 'odometer': 40160,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_3fca4b43223ed14365991b1e706d3caa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2634197,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_87a6674638215cfa31cda6d8714987df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2384076,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f15486cf47943fd737642bfa20cc4485.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_5878e5b94f73da5391e0659ae6b57300.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_6ebd2a03ed95975d0511de9b2d613076.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72837,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_f42fe268c6d277f68c696907416945f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_0998045d97bff5d83a121b65bb48aa5c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66738,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_2a19672e3f2313a89001359bc13d9983.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_9fb44a22df1b75b84268aafc0e5514c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a69eac5-d21f-5b7d-b898-a09c3a3a738b/3a69eac5-d21f-5b7d-b898-a09c3a3a738b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2495549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/97/77976cc7deaaa82862b71df6587680bc/pa/XA48872_0789cbffa75c3e8651b89a84383f024c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-14',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat 500 1.2 Happy Birthday',
 'transmission': 'manual',
 'trim': 'Happy Birthday',
 'year': 2013}
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA48872%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Saving data for XA48872: {'created_time': 1774723361.131841, 'last_price_update_time': 1774723361.131858, 'auction_closing_time': 1774885214.0}
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XA48872') HTTP/1.1" 204 0
2026-03-28 18:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with identifier: KC60426
2026-03-28 18:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with identifier: KC60426
2026-03-28 18:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 983e7f23-9f5a-57ca-a7b3-8b518a2a6026 with identifier: KC60426 to the API
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_0fcf67c66e3f67e2037a165bebc158d3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:03:22Z',
 'fuel_type': 'petrol',
 'id': '983e7f23-9f5a-57ca-a7b3-8b518a2a6026',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC60426',
 'listing': 'auction',
 'location': 'DE, Eisenach',
 'make': 'Mazda',
 'model': '3',
 'odometer': 51767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66913,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_37a970894c6b7d6de6eeaf469cc429fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_0fcf67c66e3f67e2037a165bebc158d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 315941,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_4377412f70dac315d99a47565e79583d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34338,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_e6484c6063ebb0b03bf47408c0ac832d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 325695,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_d9ca04e540016ea9b28d6a01c0179cb7.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 338603,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_c9c7c98b761fc92dd5467f8b316b3cfc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44222,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_8ba500d2291e36036b8b496e98ed8755.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47766,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_61c56383d946c81361db6292b4165695.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_20a8a5b0bc7193b4c8f8f5bdbfcadc7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_983e7f23-9f5a-57ca-a7b3-8b518a2a6026/983e7f23-9f5a-57ca-a7b3-8b518a2a6026_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52081,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img08/2b/082b08b00b83b328f91cdcb3d0f45844/pa/KC60426_974a85b0bda8cbf236314f5c3448bc8e.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-02-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda 3 2.0 Skyactiv-G Mild-Hybrid Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2022}
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC60426%27 HTTP/1.1" 200 None
2026-03-28 18:42:41 [auto1.de] INFO: Saving data for KC60426: {'created_time': 1774723361.634639, 'last_price_update_time': 1774723361.634651, 'auction_closing_time': 1774883002.0}
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC60426') HTTP/1.1" 204 0
2026-03-28 18:42:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with identifier: GL40281
2026-03-28 18:42:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with identifier: GL40281
2026-03-28 18:42:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e8a1e95-281c-5023-8bba-16c49d8a5cfe with identifier: GL40281 to the API
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_a701c197530b3c290a8f60b83a6df388.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:49:33Z',
 'fuel_type': 'petrol',
 'id': '3e8a1e95-281c-5023-8bba-16c49d8a5cfe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL40281',
 'listing': 'auction',
 'location': 'DE, Chemnitz',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 86858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2917920,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_3acc5035e67473f7a2ed1b45c43302f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3161180,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_a701c197530b3c290a8f60b83a6df388.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2973461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_01b2721fe6995df82f7f129cec3f6680.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_cecd96bebb00ce93682ec5fb2ef862f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2839113,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_ca3ac878935fae0d66b4594432ea9413.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2808872,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_35dc10a8895d76397159e2ae85fe6d7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2843624,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_64246fc27a0f2cb5a9a20d8e3b9bd6ce.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_4c1b2183af2dbcdf2f53568edce18885.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_403089c0c8b1faf9728307048a5eca98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e8a1e95-281c-5023-8bba-16c49d8a5cfe/3e8a1e95-281c-5023-8bba-16c49d8a5cfe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdb/2c/db2c8c359846135cd2ca06c98e276880/pa/GL40281_4aabe408ec7365bf025f5c20f765b5eb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.4 BoosterJet Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2019}
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL40281%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Saving data for GL40281: {'created_time': 1774723362.068285, 'last_price_update_time': 1774723362.068296, 'auction_closing_time': 1774885773.0}
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL40281') HTTP/1.1" 204 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT59270%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for DT59270: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD29600%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for SD29600: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY51976%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for AY51976: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT35256%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for KT35256: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY39038%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for ZY39038: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA52308%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for EA52308: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD45426%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for KD45426: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ43833%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for VZ43833: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA56884%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for HA56884: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80393%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for FD80393: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB41121%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for XB41121: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA22909%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for DA22909: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF10429%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for BF10429: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY13632%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for XY13632: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH64159%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for MH64159: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51280%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for CU51280: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS47391%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for TS47391: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD30879%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for JD30879: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF87196%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for ZF87196: 0
2026-03-28 18:42:42 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK10749%27 HTTP/1.1" 200 None
2026-03-28 18:42:42 [auto1.de] INFO: Scrape type for DK10749: 0
2026-03-28 18:42:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NS77188/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb40a90>
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg54%252F9a%252F549a9cf605cab811077aa4d29fb84fb6%252Fpa%252FPB68045_fcbcf3bf9725b86a98b4c8852ec05017.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_fcbcf3bf9725b86a98b4c8852ec05017.jpg saved to cache
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16a542e1-48b3-5226-965f-880ef1002860
2026-03-28 18:42:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16a542e1-48b3-5226-965f-880ef1002860, skipping ID generation
2026-03-28 18:42:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16a542e1-48b3-5226-965f-880ef1002860 with scrape type 1
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16a542e1-48b3-5226-965f-880ef1002860 sending to next pipeline
2026-03-28 18:42:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16a542e1-48b3-5226-965f-880ef1002860, identifier: PB68045
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc9bbd0>
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_30260d5272802ddc4fb67f979d38a0bf.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_30260d5272802ddc4fb67f979d38a0bf.jpg saved to cache
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19680ba3-d4ba-53c6-917f-d68876343700
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1cbbd0>
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_c9e61e96fa4b2706a9318dbf1a8518ad.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_c9e61e96fa4b2706a9318dbf1a8518ad.jpg saved to cache
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19680ba3-d4ba-53c6-917f-d68876343700
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a0af590>
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_debe277c1e2fe1aaee1ff268fe930095.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_debe277c1e2fe1aaee1ff268fe930095.jpg saved to cache
2026-03-28 18:42:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16a542e1-48b3-5226-965f-880ef1002860 with identifier: PB68045
2026-03-28 18:42:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16a542e1-48b3-5226-965f-880ef1002860 with identifier: PB68045
2026-03-28 18:42:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16a542e1-48b3-5226-965f-880ef1002860 with identifier: PB68045 to the API
2026-03-28 18:42:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_fcbcf3bf9725b86a98b4c8852ec05017.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:58:29Z',
 'fuel_type': 'diesel',
 'id': '16a542e1-48b3-5226-965f-880ef1002860',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB68045',
 'listing': 'auction',
 'location': 'DE, Seevetal',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 183889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_cc9d29b6581dda7c035d6451f02401b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_fcbcf3bf9725b86a98b4c8852ec05017.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82476,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_4a62496747ef5b595beaa2f2ce57c158.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_e29094ab6c9e956f696bfedcdc5c41b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_85d0d8f4d259d140af37cc485930ec99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_83ac8630fedd46fcba6a7f7f850fae7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_3359c4929b8f6769350b6e0d84c50d96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_614dcdcd96f005f59e53a27bd08f9766.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_736b24df723fe825e371f6cc8e33c9f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_16a542e1-48b3-5226-965f-880ef1002860/16a542e1-48b3-5226-965f-880ef1002860_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91591,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img54/9a/549a9cf605cab811077aa4d29fb84fb6/pa/PB68045_e17bad8f1c33105fe1c5b8001e8e641c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-10-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Renault Espace 1.6 dCi Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2015}
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB68045%27 HTTP/1.1" 200 None
2026-03-28 18:42:43 [auto1.de] INFO: Saving data for PB68045: {'created_time': 1774723363.188167, 'last_price_update_time': 1774723363.18818, 'auction_closing_time': 1774886309.0}
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB68045') HTTP/1.1" 204 0
2026-03-28 18:42:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_ac2202187d3e7df221754edcabf705c0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_08a12f4d9dde1b03b88520454bf4ad89.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b28a410>
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_ac2202187d3e7df221754edcabf705c0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_ac2202187d3e7df221754edcabf705c0.jpg saved to cache
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_cd240493f21730feceb9059c9eb01e42.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_9f873e3f49bd7991f2ebb8ad26755649.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb1950>
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_08a12f4d9dde1b03b88520454bf4ad89.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_08a12f4d9dde1b03b88520454bf4ad89.jpg saved to cache
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19680ba3-d4ba-53c6-917f-d68876343700
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_104f30706d84b5b8b7fc9e7009194564.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_4765b1c9671fe2749ca5c67594f2d7bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_3315bc4588558bbe9ec741baa8d507bf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_6a3f338c0f265f010bf571c52f583601.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_6e1fca5ca149a0259c02e29123cb0f1c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_8596ca30ec92f4341741db418a3c38af.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b25c850>
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_cd240493f21730feceb9059c9eb01e42.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_cd240493f21730feceb9059c9eb01e42.jpg saved to cache
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb52e90>
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252F81%252F2e81b318ff7f8544b879b97ec12370af%252Fpa%252FFF09080_9f873e3f49bd7991f2ebb8ad26755649.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_9f873e3f49bd7991f2ebb8ad26755649.jpg saved to cache
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19680ba3-d4ba-53c6-917f-d68876343700
2026-03-28 18:42:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19680ba3-d4ba-53c6-917f-d68876343700, skipping ID generation
2026-03-28 18:42:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19680ba3-d4ba-53c6-917f-d68876343700 with scrape type 1
2026-03-28 18:42:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19680ba3-d4ba-53c6-917f-d68876343700 sending to next pipeline
2026-03-28 18:42:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19680ba3-d4ba-53c6-917f-d68876343700, identifier: FF09080
2026-03-28 18:42:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19680ba3-d4ba-53c6-917f-d68876343700 with identifier: FF09080
2026-03-28 18:42:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19680ba3-d4ba-53c6-917f-d68876343700 with identifier: FF09080
2026-03-28 18:42:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19680ba3-d4ba-53c6-917f-d68876343700 with identifier: FF09080 to the API
2026-03-28 18:42:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_9f873e3f49bd7991f2ebb8ad26755649.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:19:34Z',
 'fuel_type': 'petrol',
 'id': '19680ba3-d4ba-53c6-917f-d68876343700',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF09080',
 'listing': 'auction',
 'location': 'DE, Ulm-Senden',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 107980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84303,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_d01b64cbbbe0a28f5c51bba61fc8ad9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94874,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_08a12f4d9dde1b03b88520454bf4ad89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91277,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_9f873e3f49bd7991f2ebb8ad26755649.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_c9e61e96fa4b2706a9318dbf1a8518ad.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19680ba3-d4ba-53c6-917f-d68876343700/19680ba3-d4ba-53c6-917f-d68876343700_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e81b318ff7f8544b879b97ec12370af/pa/FF09080_30260d5272802ddc4fb67f979d38a0bf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF09080%27 HTTP/1.1" 200 None
2026-03-28 18:42:44 [auto1.de] INFO: Saving data for FF09080: {'created_time': 1774723364.240495, 'last_price_update_time': 1774723364.240506, 'auction_closing_time': 1774883974.0}
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF09080') HTTP/1.1" 204 0
2026-03-28 18:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_f618165d902f5ad6ea7ffda1d76d95ea.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_b2665d6176fbf022b91809a868436ee1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_6abf8fc4013eea4885845cba649fbc86.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_ca432e5b6f221732fa3a9d63193a80f0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_818ed854efab5ec55d1a26bfada3ec27.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT32005> (referer: https://www.auto1.com/v1/car-details-view/GT32005/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb8bd0>
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_104f30706d84b5b8b7fc9e7009194564.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_104f30706d84b5b8b7fc9e7009194564.jpg saved to cache
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0e550>
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Fe2%252Fcbe2114d7a726ba8d2486bc457fe9def%252Fpa%252FGF23268_4765b1c9671fe2749ca5c67594f2d7bb.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_4765b1c9671fe2749ca5c67594f2d7bb.jpg saved to cache
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87a44eab-d965-53e9-8713-c9d1119b1bbe
2026-03-28 18:42:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87a44eab-d965-53e9-8713-c9d1119b1bbe, skipping ID generation
2026-03-28 18:42:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87a44eab-d965-53e9-8713-c9d1119b1bbe with scrape type 1
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87a44eab-d965-53e9-8713-c9d1119b1bbe sending to next pipeline
2026-03-28 18:42:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87a44eab-d965-53e9-8713-c9d1119b1bbe, identifier: GF23268
2026-03-28 18:42:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0d090>
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_3315bc4588558bbe9ec741baa8d507bf.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_3315bc4588558bbe9ec741baa8d507bf.jpg saved to cache
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17ffd0>
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_6a3f338c0f265f010bf571c52f583601.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_6a3f338c0f265f010bf571c52f583601.jpg saved to cache
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4beb0a10>
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_6e1fca5ca149a0259c02e29123cb0f1c.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_6e1fca5ca149a0259c02e29123cb0f1c.jpg saved to cache
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb
2026-03-28 18:42:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcbb5d0>
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_8596ca30ec92f4341741db418a3c38af.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_8596ca30ec92f4341741db418a3c38af.jpg saved to cache
2026-03-28 18:42:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87a44eab-d965-53e9-8713-c9d1119b1bbe with identifier: GF23268
2026-03-28 18:42:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87a44eab-d965-53e9-8713-c9d1119b1bbe with identifier: GF23268
2026-03-28 18:42:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87a44eab-d965-53e9-8713-c9d1119b1bbe with identifier: GF23268 to the API
2026-03-28 18:42:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_4765b1c9671fe2749ca5c67594f2d7bb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:31:50Z',
 'fuel_type': 'petrol',
 'id': '87a44eab-d965-53e9-8713-c9d1119b1bbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF23268',
 'listing': 'auction',
 'location': 'DE, Pforzheim',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 105949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76563,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_4765b1c9671fe2749ca5c67594f2d7bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_eb1d2f6b4be15dcaba7566b9d58a2aab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_d3a83104521441f97ab42e4ed336790f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2814589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_824299475b200e9aa187ef41bdb5d46b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592552,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_23984b5190af106d572a765836aaf722.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_6d8521ff5775c2479be144bd470f39fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687297,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_9c27be70869858bc21996ad00bf30623.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612895,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_7aaa87d65cbedcd42f30674a672382d7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_1a6409c01daf06f0ede0ffe7a8f4ac62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87a44eab-d965-53e9-8713-c9d1119b1bbe/87a44eab-d965-53e9-8713-c9d1119b1bbe_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/e2/cbe2114d7a726ba8d2486bc457fe9def/pa/GF23268_cf27b87c307a65ba4086ab967e00b0c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2017}
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF23268%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [auto1.de] INFO: Saving data for GF23268: {'created_time': 1774723365.263027, 'last_price_update_time': 1774723365.26304, 'auction_closing_time': 1774884710.0}
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF23268') HTTP/1.1" 204 0
2026-03-28 18:42:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NS77188> (referer: https://www.auto1.com/v1/car-details-view/NS77188/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b151290>
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_f618165d902f5ad6ea7ffda1d76d95ea.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_f618165d902f5ad6ea7ffda1d76d95ea.jpg saved to cache
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 405d8db0-717e-542e-a79f-040449742afa
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd36c10>
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_b2665d6176fbf022b91809a868436ee1.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_b2665d6176fbf022b91809a868436ee1.jpg saved to cache
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 405d8db0-717e-542e-a79f-040449742afa
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbb0c50>
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_6abf8fc4013eea4885845cba649fbc86.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_6abf8fc4013eea4885845cba649fbc86.jpg saved to cache
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7170bc35-b369-51fe-9853-ccc3996dc328
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbfb710>
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F73%252F47734eab4a84f40c24bbceccb3a937cc%252Fpa%252FHL01555_ca432e5b6f221732fa3a9d63193a80f0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_ca432e5b6f221732fa3a9d63193a80f0.jpg saved to cache
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb
2026-03-28 18:42:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb, skipping ID generation
2026-03-28 18:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with scrape type 1
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb sending to next pipeline
2026-03-28 18:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb, identifier: HL01555
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b07a610>
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F18%252F731808fa7e11dfe86255bb61fa84c569%252Fpa%252FXK86012_818ed854efab5ec55d1a26bfada3ec27.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_818ed854efab5ec55d1a26bfada3ec27.jpg saved to cache
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb
2026-03-28 18:42:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 501a9d1d-ea59-57b2-a48c-2acd83c690cb, skipping ID generation
2026-03-28 18:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb with scrape type 1
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 501a9d1d-ea59-57b2-a48c-2acd83c690cb sending to next pipeline
2026-03-28 18:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 501a9d1d-ea59-57b2-a48c-2acd83c690cb, identifier: XK86012
2026-03-28 18:42:45 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 369fb740-341e-5403-ac15-c2016424baf8 with identifier: GT32005
2026-03-28 18:42:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 369fb740-341e-5403-ac15-c2016424baf8 with scrape type 1
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 369fb740-341e-5403-ac15-c2016424baf8
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_0322c0fef5fd04d1a36a2f0a3885894f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_0322c0fef5fd04d1a36a2f0a3885894f.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_b168742f538d6d9e47fac6b64cd5de1d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_b168742f538d6d9e47fac6b64cd5de1d.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_c6f40e17b0c5830e4422c9d10037eb47.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c6f40e17b0c5830e4422c9d10037eb47.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_8753e060d5977aeb5d59f3cd8bbbc673.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_8753e060d5977aeb5d59f3cd8bbbc673.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_c5a535c877f6f5407356a40af762ecdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c5a535c877f6f5407356a40af762ecdd.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_0f28f701258aefd3ebb11acad13946de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_0f28f701258aefd3ebb11acad13946de.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_bee3e9fec79d6db1a2a272c28c02fee9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_bee3e9fec79d6db1a2a272c28c02fee9.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_af8010205e4f2d414ad26dc0fcd4b883.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_af8010205e4f2d414ad26dc0fcd4b883.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_c22a69cd3a16a8d3f452404124fc76fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c22a69cd3a16a8d3f452404124fc76fa.jpg already downloaded
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg57%252Fcf%252F57cfa2482e99209fbfc8c30284350744%252Fpa%252FGT32005_5d276c86fc146823d0841dbf0efca215.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_5d276c86fc146823d0841dbf0efca215.jpg already downloaded
2026-03-28 18:42:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 369fb740-341e-5403-ac15-c2016424baf8, identifier: GT32005
2026-03-28 18:42:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with identifier: HL01555
2026-03-28 18:42:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with identifier: HL01555
2026-03-28 18:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb with identifier: HL01555 to the API
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_ca432e5b6f221732fa3a9d63193a80f0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:00Z',
 'fuel_type': 'diesel',
 'id': '6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL01555',
 'listing': 'auction',
 'location': 'DE, Schweinfurt',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 225949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_6e1fca5ca149a0259c02e29123cb0f1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_ca432e5b6f221732fa3a9d63193a80f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_582803613550e3b8c2b434ddc80100a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_91491957822ea6f3ea18e1b7e7a37eee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb/6d4bdeb4-1d21-5e6f-bd7e-e17e9de61bfb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126177,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/73/47734eab4a84f40c24bbceccb3a937cc/pa/HL01555_77a24ee79f6999f3c9ba69001fa4dcd8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL01555%27 HTTP/1.1" 200 None
2026-03-28 18:42:46 [auto1.de] INFO: Saving data for HL01555: {'created_time': 1774723366.377894, 'last_price_update_time': 1774723366.377909, 'auction_closing_time': 1774883820.0}
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL01555') HTTP/1.1" 204 0
2026-03-28 18:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 501a9d1d-ea59-57b2-a48c-2acd83c690cb with identifier: XK86012
2026-03-28 18:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 501a9d1d-ea59-57b2-a48c-2acd83c690cb with identifier: XK86012
2026-03-28 18:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 501a9d1d-ea59-57b2-a48c-2acd83c690cb with identifier: XK86012 to the API
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_818ed854efab5ec55d1a26bfada3ec27.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:04:37Z',
 'fuel_type': 'petrol',
 'id': '501a9d1d-ea59-57b2-a48c-2acd83c690cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XK86012',
 'listing': 'auction',
 'location': 'DE, Schwäbisch Hall',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 194345,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_818ed854efab5ec55d1a26bfada3ec27.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_8cbbd0138633af6f9330d8f32c1690cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_51f7b79e88fb316befba4ee2864a2949.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70632,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_a433cdad2dc2d06b16440ed76018d850.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_fefdc08e44829822d4986c8a488d947d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501a9d1d-ea59-57b2-a48c-2acd83c690cb/501a9d1d-ea59-57b2-a48c-2acd83c690cb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/18/731808fa7e11dfe86255bb61fa84c569/pa/XK86012_6af11414da5644d528dbfaf6fde0d92f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-24',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK86012%27 HTTP/1.1" 200 None
2026-03-28 18:42:46 [auto1.de] INFO: Saving data for XK86012: {'created_time': 1774723366.793237, 'last_price_update_time': 1774723366.793248, 'auction_closing_time': 1774883077.0}
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XK86012') HTTP/1.1" 204 0
2026-03-28 18:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 369fb740-341e-5403-ac15-c2016424baf8 with identifier: GT32005
2026-03-28 18:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 369fb740-341e-5403-ac15-c2016424baf8 with identifier: GT32005
2026-03-28 18:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 369fb740-341e-5403-ac15-c2016424baf8 with identifier: GT32005 to the API
2026-03-28 18:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GT32005>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:29:17Z',
 'fuel_type': 'hybrid',
 'id': '369fb740-341e-5403-ac15-c2016424baf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT32005',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 42452,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_0322c0fef5fd04d1a36a2f0a3885894f.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_b168742f538d6d9e47fac6b64cd5de1d.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c6f40e17b0c5830e4422c9d10037eb47.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_8753e060d5977aeb5d59f3cd8bbbc673.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c5a535c877f6f5407356a40af762ecdd.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_0f28f701258aefd3ebb11acad13946de.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_bee3e9fec79d6db1a2a272c28c02fee9.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_af8010205e4f2d414ad26dc0fcd4b883.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c22a69cd3a16a8d3f452404124fc76fa.jpg',
                'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_5d276c86fc146823d0841dbf0efca215.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2537448,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_0322c0fef5fd04d1a36a2f0a3885894f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_b168742f538d6d9e47fac6b64cd5de1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2217909,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c6f40e17b0c5830e4422c9d10037eb47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2321152,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_8753e060d5977aeb5d59f3cd8bbbc673.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2093445,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c5a535c877f6f5407356a40af762ecdd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2227407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_0f28f701258aefd3ebb11acad13946de.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_bee3e9fec79d6db1a2a272c28c02fee9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71542,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_af8010205e4f2d414ad26dc0fcd4b883.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_c22a69cd3a16a8d3f452404124fc76fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_369fb740-341e-5403-ac15-c2016424baf8/369fb740-341e-5403-ac15-c2016424baf8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img57/cf/57cfa2482e99209fbfc8c30284350744/pa/GT32005_5d276c86fc146823d0841dbf0efca215.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-10-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2021}
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT32005%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Saving data for GT32005: {'created_time': 1774723367.124012, 'last_price_update_time': 1774723367.124029, 'auction_closing_time': 1774884557.0}
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT32005') HTTP/1.1" 204 0
2026-03-28 18:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD00982%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for DD00982: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV93942%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for JV93942: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR37288%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for RR37288: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL20163%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for XL20163: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW03523%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for RW03523: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY17523%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for ZY17523: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW53776%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for GW53776: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH41345%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for PH41345: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79072%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for FB79072: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW07987%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for KW07987: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC06893%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for HC06893: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM85402%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for BM85402: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA67550%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for CA67550: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG02351%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for ZG02351: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK87241%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for UK87241: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ27517%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for PJ27517: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN00804%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for MN00804: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH25955%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for GH25955: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF81396%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for AF81396: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ89028%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for FJ89028: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY71036%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for GY71036: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB96226%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for HB96226: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS36349%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for GS36349: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA50795%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for HA50795: 0
2026-03-28 18:42:47 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ55149%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [auto1.de] INFO: Scrape type for UZ55149: 0
2026-03-28 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EN09392/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT06996/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81a471fa-9cb8-56bb-baf2-90bb025769bb with identifier: NS77188
2026-03-28 18:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a471fa-9cb8-56bb-baf2-90bb025769bb with scrape type 1
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_3304eb6a3ea5b935ebaba0fb5cd31f31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3304eb6a3ea5b935ebaba0fb5cd31f31.jpg not downloaded yet
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_3fddb5b6b52c6a19d08c02a23ade7d16.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3fddb5b6b52c6a19d08c02a23ade7d16.jpg not downloaded yet
2026-03-28 18:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_ee8a08521e1d4e25eb523ef02156d92e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_ee8a08521e1d4e25eb523ef02156d92e.jpg not downloaded yet
2026-03-28 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_6bcc970f3d32cf67f562feb0ee99fb2f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_d7ab2c2e7509de74ec47e0941fdb2ffe.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_7d2007bf39512a3206bfe5e5d42d3138.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_edae98e28c98eebe464c8965c044213a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_1fbded06a59271860cd16c0aa6c2f808.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_1fbded06a59271860cd16c0aa6c2f808.jpg not downloaded yet
2026-03-28 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_1264249c5ac1178a2a034c0ee6b5073b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_b7fb5a0e6537ff967c376d7178350dfc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_b7fb5a0e6537ff967c376d7178350dfc.jpg not downloaded yet
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_982c988e48a3c273ff7a5070602de5a1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_982c988e48a3c273ff7a5070602de5a1.jpg not downloaded yet
2026-03-28 18:42:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_bbac06957a9c3edad3bd16d7f05af562.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_0401708da231bbe4260727b13be1e156.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_0401708da231bbe4260727b13be1e156.jpg not downloaded yet
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_52b75b1988679c76c1c9664a716108ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_52b75b1988679c76c1c9664a716108ff.jpg not downloaded yet
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_a4e46676a9461f53638eb5bb8ec5d596.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_a4e46676a9461f53638eb5bb8ec5d596.jpg not downloaded yet
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_f3e9df21babff95fd554fcad0faa4b53.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_f3e9df21babff95fd554fcad0faa4b53.jpg not downloaded yet
2026-03-28 18:42:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b296750>
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_6bcc970f3d32cf67f562feb0ee99fb2f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_6bcc970f3d32cf67f562feb0ee99fb2f.jpg saved to cache
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b22ef90>
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_d7ab2c2e7509de74ec47e0941fdb2ffe.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_d7ab2c2e7509de74ec47e0941fdb2ffe.jpg saved to cache
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 405d8db0-717e-542e-a79f-040449742afa
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd36b10>
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252Fcf%252Fafcfed38b4109b3443bc911cb021bc48%252Fpa%252FZD03679_7d2007bf39512a3206bfe5e5d42d3138.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_7d2007bf39512a3206bfe5e5d42d3138.jpg saved to cache
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 405d8db0-717e-542e-a79f-040449742afa
2026-03-28 18:42:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 405d8db0-717e-542e-a79f-040449742afa, skipping ID generation
2026-03-28 18:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 405d8db0-717e-542e-a79f-040449742afa with scrape type 1
2026-03-28 18:42:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 405d8db0-717e-542e-a79f-040449742afa sending to next pipeline
2026-03-28 18:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 405d8db0-717e-542e-a79f-040449742afa, identifier: ZD03679
2026-03-28 18:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59feb2d0>
2026-03-28 18:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_edae98e28c98eebe464c8965c044213a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_edae98e28c98eebe464c8965c044213a.jpg saved to cache
2026-03-28 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7170bc35-b369-51fe-9853-ccc3996dc328
2026-03-28 18:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 405d8db0-717e-542e-a79f-040449742afa with identifier: ZD03679
2026-03-28 18:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 405d8db0-717e-542e-a79f-040449742afa with identifier: ZD03679
2026-03-28 18:42:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 405d8db0-717e-542e-a79f-040449742afa with identifier: ZD03679 to the API
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_7d2007bf39512a3206bfe5e5d42d3138.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 185,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:19:57Z',
 'fuel_type': 'petrol',
 'id': '405d8db0-717e-542e-a79f-040449742afa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD03679',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 130847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89606,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_d7ab2c2e7509de74ec47e0941fdb2ffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_7d2007bf39512a3206bfe5e5d42d3138.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_b2665d6176fbf022b91809a868436ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87012,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_54aedf2f9b71093621019cadc93dcb28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_405d8db0-717e-542e-a79f-040449742afa/405d8db0-717e-542e-a79f-040449742afa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117923,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/cf/afcfed38b4109b3443bc911cb021bc48/pa/ZD03679_f618165d902f5ad6ea7ffda1d76d95ea.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-11-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2000}
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD03679%27 HTTP/1.1" 200 None
2026-03-28 18:42:48 [auto1.de] INFO: Saving data for ZD03679: {'created_time': 1774723368.628663, 'last_price_update_time': 1774723368.628676, 'auction_closing_time': 1774883997.0}
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD03679') HTTP/1.1" 204 0
2026-03-28 18:42:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6a550>
2026-03-28 18:42:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fd6%252F0fd6e9cdf866cd4dec55fc7ccf7ae0c5%252Fpa%252FWC65602_1264249c5ac1178a2a034c0ee6b5073b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_1264249c5ac1178a2a034c0ee6b5073b.jpg saved to cache
2026-03-28 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item db665ca2-fa02-5c51-b61d-83e72285554d
2026-03-28 18:42:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: db665ca2-fa02-5c51-b61d-83e72285554d, skipping ID generation
2026-03-28 18:42:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db665ca2-fa02-5c51-b61d-83e72285554d with scrape type 1
2026-03-28 18:42:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item db665ca2-fa02-5c51-b61d-83e72285554d sending to next pipeline
2026-03-28 18:42:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db665ca2-fa02-5c51-b61d-83e72285554d, identifier: WC65602
2026-03-28 18:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RN07993/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB90564> (referer: https://www.auto1.com/v1/car-details-view/GB90564/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ17275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YD01023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KJ96076> (referer: https://www.auto1.com/v1/car-details-view/KJ96076/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db665ca2-fa02-5c51-b61d-83e72285554d with identifier: WC65602
2026-03-28 18:42:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db665ca2-fa02-5c51-b61d-83e72285554d with identifier: WC65602
2026-03-28 18:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db665ca2-fa02-5c51-b61d-83e72285554d with identifier: WC65602 to the API
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_1264249c5ac1178a2a034c0ee6b5073b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:02:09Z',
 'fuel_type': 'petrol',
 'id': 'db665ca2-fa02-5c51-b61d-83e72285554d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC65602',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 87221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_09bc3ee5c462e2a5927684d950aa5ea9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3280957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_6bcc970f3d32cf67f562feb0ee99fb2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_cd240493f21730feceb9059c9eb01e42.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2670270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_3315bc4588558bbe9ec741baa8d507bf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_debe277c1e2fe1aaee1ff268fe930095.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2933843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_ac2202187d3e7df221754edcabf705c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2640607,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_1264249c5ac1178a2a034c0ee6b5073b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2964908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_8596ca30ec92f4341741db418a3c38af.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_104f30706d84b5b8b7fc9e7009194564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_db665ca2-fa02-5c51-b61d-83e72285554d/db665ca2-fa02-5c51-b61d-83e72285554d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2702587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/d6/0fd6e9cdf866cd4dec55fc7ccf7ae0c5/pa/WC65602_6a3f338c0f265f010bf571c52f583601.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-03-29',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2010}
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC65602%27 HTTP/1.1" 200 None
2026-03-28 18:42:49 [auto1.de] INFO: Saving data for WC65602: {'created_time': 1774723369.369402, 'last_price_update_time': 1774723369.369413, 'auction_closing_time': 1774882929.0}
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC65602') HTTP/1.1" 204 0
2026-03-28 18:42:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc22dd0>
2026-03-28 18:42:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F3d%252F2d3d3701062d63911d52c9fea785c139%252Fpa%252FNE29415_bbac06957a9c3edad3bd16d7f05af562.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_bbac06957a9c3edad3bd16d7f05af562.jpg saved to cache
2026-03-28 18:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7170bc35-b369-51fe-9853-ccc3996dc328
2026-03-28 18:42:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7170bc35-b369-51fe-9853-ccc3996dc328, skipping ID generation
2026-03-28 18:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7170bc35-b369-51fe-9853-ccc3996dc328 with scrape type 1
2026-03-28 18:42:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7170bc35-b369-51fe-9853-ccc3996dc328 sending to next pipeline
2026-03-28 18:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7170bc35-b369-51fe-9853-ccc3996dc328, identifier: NE29415
2026-03-28 18:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7170bc35-b369-51fe-9853-ccc3996dc328 with identifier: NE29415
2026-03-28 18:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7170bc35-b369-51fe-9853-ccc3996dc328 with identifier: NE29415
2026-03-28 18:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7170bc35-b369-51fe-9853-ccc3996dc328 with identifier: NE29415 to the API
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_bbac06957a9c3edad3bd16d7f05af562.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:01:46Z',
 'fuel_type': 'diesel',
 'id': '7170bc35-b369-51fe-9853-ccc3996dc328',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE29415',
 'listing': 'auction',
 'location': 'DE, Regensburg',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 161037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112905,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_edae98e28c98eebe464c8965c044213a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_bbac06957a9c3edad3bd16d7f05af562.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85610,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_6abf8fc4013eea4885845cba649fbc86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_b382d000a44c9b8db7b9d6f48171c64b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7170bc35-b369-51fe-9853-ccc3996dc328/7170bc35-b369-51fe-9853-ccc3996dc328_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 114378,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/3d/2d3d3701062d63911d52c9fea785c139/pa/NE29415_f3e5641ea502b03d38deacd3d005a539.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-03-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.6 CRDi Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE29415%27 HTTP/1.1" 200 None
2026-03-28 18:42:49 [auto1.de] INFO: Saving data for NE29415: {'created_time': 1774723369.950217, 'last_price_update_time': 1774723369.950234, 'auction_closing_time': 1774882906.0}
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE29415') HTTP/1.1" 204 0
2026-03-28 18:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f073838-314c-5126-b94c-d4da47a67f4f with identifier: GB90564
2026-03-28 18:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f073838-314c-5126-b94c-d4da47a67f4f with scrape type 1
2026-03-28 18:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_ff280136d0116b088d6afcac2e4e0ca8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_ff280136d0116b088d6afcac2e4e0ca8.jpg not downloaded yet
2026-03-28 18:42:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with identifier: KJ96076
2026-03-28 18:42:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with scrape type 1
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_a110e2b4024cdd1ba9258ce3bf2950cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_a110e2b4024cdd1ba9258ce3bf2950cd.jpg not downloaded yet
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_52b75b1988679c76c1c9664a716108ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_f3e9df21babff95fd554fcad0faa4b53.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_a4e46676a9461f53638eb5bb8ec5d596.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_99ffcb6d484cc670781f17c698d979a5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_99ffcb6d484cc670781f17c698d979a5.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_cd760494b54227ac2ad5821a6747e2de.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_cd760494b54227ac2ad5821a6747e2de.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_f5c360e39c6dc3ac5d33e4f8db17ef10.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_f5c360e39c6dc3ac5d33e4f8db17ef10.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_9a5dbb9a2e7a9daedfbc057eda0ff2cc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_9a5dbb9a2e7a9daedfbc057eda0ff2cc.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_b512a04f343f77397ef5007d218a7c9a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_b512a04f343f77397ef5007d218a7c9a.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_5be9d50335dd535935d026c20579a14a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_5be9d50335dd535935d026c20579a14a.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_fefbf39486139b00525fdd74f123be32.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_fefbf39486139b00525fdd74f123be32.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_e8236371dc79a1f11ec96cfe9f2aa500.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_e8236371dc79a1f11ec96cfe9f2aa500.jpg not downloaded yet
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_608bccf21d0426e491bd0e50cd24bbb0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_0778adc8b390e71ef18721964a65a925.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_0778adc8b390e71ef18721964a65a925.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_b02268d28f2cdaa5f33df5799555ac76.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_b02268d28f2cdaa5f33df5799555ac76.jpg not downloaded yet
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc00f10>
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_52b75b1988679c76c1c9664a716108ff.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_52b75b1988679c76c1c9664a716108ff.jpg saved to cache
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b26ff10>
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_f3e9df21babff95fd554fcad0faa4b53.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_f3e9df21babff95fd554fcad0faa4b53.jpg saved to cache
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b29abd0>
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_a4e46676a9461f53638eb5bb8ec5d596.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_a4e46676a9461f53638eb5bb8ec5d596.jpg saved to cache
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:50 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_b7fb5a0e6537ff967c376d7178350dfc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_1fbded06a59271860cd16c0aa6c2f808.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_ee8a08521e1d4e25eb523ef02156d92e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_9cf38972acbd6af2e2ff8155578fafef.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_9cf38972acbd6af2e2ff8155578fafef.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_a668be6e27c26cb41c5b28283c1b185f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_a668be6e27c26cb41c5b28283c1b185f.jpg not downloaded yet
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC03535%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for NC03535: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR22131%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for HR22131: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM01256%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for YM01256: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD09354%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for AD09354: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD36788%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for YD36788: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY64053%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for EY64053: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK14391%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for NK14391: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA88960%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for HA88960: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV20886%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for CV20886: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF20079%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for BF20079: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH86831%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for YH86831: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU24004%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for GU24004: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR12848%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for KR12848: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE39516%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for UE39516: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR83304%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for RR83304: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93366%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for GM93366: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV13794%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for VV13794: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ93314%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for YZ93314: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE64138%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for ZE64138: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH72870%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for FH72870: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV36249%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for RV36249: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR32471%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for GR32471: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ69669%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for TJ69669: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX33153%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for CX33153: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL82798%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for XL82798: 0
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-28 18:42:50 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE88009%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [auto1.de] INFO: Scrape type for DE88009: 0
2026-03-28 18:42:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_8e5d9444791f16ff88e6ff33ab6a8338.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_8e5d9444791f16ff88e6ff33ab6a8338.jpg not downloaded yet
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_937e8840737b020ddd4ca22c2b8df347.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_937e8840737b020ddd4ca22c2b8df347.jpg not downloaded yet
2026-03-28 18:42:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be92f10>
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_608bccf21d0426e491bd0e50cd24bbb0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_608bccf21d0426e491bd0e50cd24bbb0.jpg saved to cache
2026-03-28 18:42:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0e250>
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_b7fb5a0e6537ff967c376d7178350dfc.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_b7fb5a0e6537ff967c376d7178350dfc.jpg saved to cache
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fe1190>
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_1fbded06a59271860cd16c0aa6c2f808.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_1fbded06a59271860cd16c0aa6c2f808.jpg saved to cache
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b079f50>
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_ee8a08521e1d4e25eb523ef02156d92e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_ee8a08521e1d4e25eb523ef02156d92e.jpg saved to cache
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_879b0ae2d7923d00473e378817cd45e8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_879b0ae2d7923d00473e378817cd45e8.jpg not downloaded yet
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_f44ae61065f1ba2d9d746c252732b7bb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_f44ae61065f1ba2d9d746c252732b7bb.jpg not downloaded yet
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_a110e2b4024cdd1ba9258ce3bf2950cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_e8236371dc79a1f11ec96cfe9f2aa500.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_b02268d28f2cdaa5f33df5799555ac76.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_36cf94eb8b037f34626b1a146188b063.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_36cf94eb8b037f34626b1a146188b063.jpg not downloaded yet
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_52d3a08eb24f330c052c0ef78391327c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_52d3a08eb24f330c052c0ef78391327c.jpg not downloaded yet
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ebe7192fc50bda0dca823a3505d615a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3304eb6a3ea5b935ebaba0fb5cd31f31.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_982c988e48a3c273ff7a5070602de5a1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_0401708da231bbe4260727b13be1e156.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3fddb5b6b52c6a19d08c02a23ade7d16.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_0778adc8b390e71ef18721964a65a925.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_879b0ae2d7923d00473e378817cd45e8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb94150>
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_a110e2b4024cdd1ba9258ce3bf2950cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_a110e2b4024cdd1ba9258ce3bf2950cd.jpg saved to cache
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_f44ae61065f1ba2d9d746c252732b7bb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1516d0>
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_e8236371dc79a1f11ec96cfe9f2aa500.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_e8236371dc79a1f11ec96cfe9f2aa500.jpg saved to cache
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b679933d0>
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_b02268d28f2cdaa5f33df5799555ac76.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_b02268d28f2cdaa5f33df5799555ac76.jpg saved to cache
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b153990>
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8b%252F62%252F8b6259b0cf16f21d20fd73995a0cdb25%252Fpa%252FRS29828_ebe7192fc50bda0dca823a3505d615a0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ebe7192fc50bda0dca823a3505d615a0.jpg saved to cache
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 452d4ce6-60d2-54c4-969e-220d7d63db57
2026-03-28 18:42:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 452d4ce6-60d2-54c4-969e-220d7d63db57, skipping ID generation
2026-03-28 18:42:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 452d4ce6-60d2-54c4-969e-220d7d63db57 with scrape type 1
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 452d4ce6-60d2-54c4-969e-220d7d63db57 sending to next pipeline
2026-03-28 18:42:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 452d4ce6-60d2-54c4-969e-220d7d63db57, identifier: RS29828
2026-03-28 18:42:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be91050>
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_3304eb6a3ea5b935ebaba0fb5cd31f31.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3304eb6a3ea5b935ebaba0fb5cd31f31.jpg saved to cache
2026-03-28 18:42:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c2ed0>
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_982c988e48a3c273ff7a5070602de5a1.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_982c988e48a3c273ff7a5070602de5a1.jpg saved to cache
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b58be4f50>
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_0401708da231bbe4260727b13be1e156.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_0401708da231bbe4260727b13be1e156.jpg saved to cache
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0119d0>
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgeb%252F4e%252Feb4e8eec3c85ff5999e6ac33c6f3bfe5%252Fpa%252FNS77188_3fddb5b6b52c6a19d08c02a23ade7d16.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3fddb5b6b52c6a19d08c02a23ade7d16.jpg saved to cache
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81a471fa-9cb8-56bb-baf2-90bb025769bb
2026-03-28 18:42:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81a471fa-9cb8-56bb-baf2-90bb025769bb, skipping ID generation
2026-03-28 18:42:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81a471fa-9cb8-56bb-baf2-90bb025769bb with scrape type 1
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81a471fa-9cb8-56bb-baf2-90bb025769bb sending to next pipeline
2026-03-28 18:42:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81a471fa-9cb8-56bb-baf2-90bb025769bb, identifier: NS77188
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d28450>
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_0778adc8b390e71ef18721964a65a925.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_0778adc8b390e71ef18721964a65a925.jpg saved to cache
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd53d10>
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_879b0ae2d7923d00473e378817cd45e8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_879b0ae2d7923d00473e378817cd45e8.jpg saved to cache
2026-03-28 18:42:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 452d4ce6-60d2-54c4-969e-220d7d63db57 with identifier: RS29828
2026-03-28 18:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 452d4ce6-60d2-54c4-969e-220d7d63db57 with identifier: RS29828
2026-03-28 18:42:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 452d4ce6-60d2-54c4-969e-220d7d63db57 with identifier: RS29828 to the API
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ebe7192fc50bda0dca823a3505d615a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 76,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:36:21Z',
 'fuel_type': 'hybrid',
 'id': '452d4ce6-60d2-54c4-969e-220d7d63db57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS29828',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Toyota',
 'model': 'Prius',
 'odometer': 88582,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3078532,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ebe7192fc50bda0dca823a3505d615a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2906843,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_608bccf21d0426e491bd0e50cd24bbb0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64761,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_18845682c84513a85c9e52a82b6e989f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_f92369d5e4b2954791b640130a640181.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3032170,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_e696fb16797eccccfe3475169deba4ca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2848246,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_7d5fb3cf03adf0d01cc3358cfb935ef4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_ce6233800e2b31c34cb03940a81db51d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2862644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_c4675cf820ae7e6a5065ff821755e831.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2877313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_9e9980a9a21b7c6b9851089859f93686.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_452d4ce6-60d2-54c4-969e-220d7d63db57/452d4ce6-60d2-54c4-969e-220d7d63db57_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3329681,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8b/62/8b6259b0cf16f21d20fd73995a0cdb25/pa/RS29828_006a3fef21709d836e6dad33fa339115.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Prius 1.8 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2016}
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS29828%27 HTTP/1.1" 200 None
2026-03-28 18:42:52 [auto1.de] INFO: Saving data for RS29828: {'created_time': 1774723372.834844, 'last_price_update_time': 1774723372.834856, 'auction_closing_time': 1774884981.0}
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS29828') HTTP/1.1" 204 0
2026-03-28 18:42:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81a471fa-9cb8-56bb-baf2-90bb025769bb with identifier: NS77188
2026-03-28 18:42:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81a471fa-9cb8-56bb-baf2-90bb025769bb with identifier: NS77188
2026-03-28 18:42:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81a471fa-9cb8-56bb-baf2-90bb025769bb with identifier: NS77188 to the API
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3fddb5b6b52c6a19d08c02a23ade7d16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:23Z',
 'fuel_type': 'diesel',
 'id': '81a471fa-9cb8-56bb-baf2-90bb025769bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS77188',
 'listing': 'auction',
 'location': 'DE, Waiblingen',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 115976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3161600,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3304eb6a3ea5b935ebaba0fb5cd31f31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3004790,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_3fddb5b6b52c6a19d08c02a23ade7d16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_ee8a08521e1d4e25eb523ef02156d92e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_1fbded06a59271860cd16c0aa6c2f808.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59205,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_b7fb5a0e6537ff967c376d7178350dfc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744693,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_982c988e48a3c273ff7a5070602de5a1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3000318,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_0401708da231bbe4260727b13be1e156.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71051,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_52b75b1988679c76c1c9664a716108ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_a4e46676a9461f53638eb5bb8ec5d596.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81a471fa-9cb8-56bb-baf2-90bb025769bb/81a471fa-9cb8-56bb-baf2-90bb025769bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74962,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgeb/4e/eb4e8eec3c85ff5999e6ac33c6f3bfe5/pa/NS77188_f3e9df21babff95fd554fcad0faa4b53.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion Tech',
 'year': 2017}
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS77188%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [auto1.de] INFO: Saving data for NS77188: {'created_time': 1774723373.324008, 'last_price_update_time': 1774723373.32402, 'auction_closing_time': 1774883063.0}
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS77188') HTTP/1.1" 204 0
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb91c50>
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_f44ae61065f1ba2d9d746c252732b7bb.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_f44ae61065f1ba2d9d746c252732b7bb.jpg saved to cache
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT06996> (referer: https://www.auto1.com/v1/car-details-view/DT06996/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX51529> (referer: https://www.auto1.com/v1/car-details-view/VX51529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HE47734/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EN09392> (referer: https://www.auto1.com/v1/car-details-view/EN09392/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS01468> (referer: https://www.auto1.com/v1/car-details-view/SS01468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_937e8840737b020ddd4ca22c2b8df347.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_52d3a08eb24f330c052c0ef78391327c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_9cf38972acbd6af2e2ff8155578fafef.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_5be9d50335dd535935d026c20579a14a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_fefbf39486139b00525fdd74f123be32.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_8e5d9444791f16ff88e6ff33ab6a8338.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_36cf94eb8b037f34626b1a146188b063.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a18af995-1367-5cd1-8126-b25ff08bf268 with identifier: DT06996
2026-03-28 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18af995-1367-5cd1-8126-b25ff08bf268 with scrape type 1
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_f63a38bde8901f158c8ae92530845e2e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_f63a38bde8901f158c8ae92530845e2e.jpg not downloaded yet
2026-03-28 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8820817c-b125-54c0-a95f-1d9485e8fbcb with identifier: VX51529
2026-03-28 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8820817c-b125-54c0-a95f-1d9485e8fbcb with scrape type 1
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_d849d981541dface4983a60247b1f8cf.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_d849d981541dface4983a60247b1f8cf.jpg not downloaded yet
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_b512a04f343f77397ef5007d218a7c9a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_cdb2c00605465e0ee90b389f783321f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_cdb2c00605465e0ee90b389f783321f7.jpg not downloaded yet
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_f8b2ace27188c60e1c41ab9cc46488dd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_f8b2ace27188c60e1c41ab9cc46488dd.jpg not downloaded yet
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_f5c360e39c6dc3ac5d33e4f8db17ef10.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_cd760494b54227ac2ad5821a6747e2de.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_99ffcb6d484cc670781f17c698d979a5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_ff280136d0116b088d6afcac2e4e0ca8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with identifier: EN09392
2026-03-28 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with scrape type 1
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_2b358a6eeb5911396115943629f9e402.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_2b358a6eeb5911396115943629f9e402.jpg not downloaded yet
2026-03-28 18:42:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a74e390b-610e-54b1-b986-abaacfc03fee with identifier: SS01468
2026-03-28 18:42:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a74e390b-610e-54b1-b986-abaacfc03fee with scrape type 1
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_cdb5bc2a35502c87e49a83c417f844fd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_cdb5bc2a35502c87e49a83c417f844fd.jpg not downloaded yet
2026-03-28 18:42:53 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b041dd0>
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_937e8840737b020ddd4ca22c2b8df347.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_937e8840737b020ddd4ca22c2b8df347.jpg saved to cache
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2c4350>
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_52d3a08eb24f330c052c0ef78391327c.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_52d3a08eb24f330c052c0ef78391327c.jpg saved to cache
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_37c463276387149d54d0e0e83b19d82f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_37c463276387149d54d0e0e83b19d82f.jpg not downloaded yet
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_9f9ef89074798a7def17414907040825.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_9f9ef89074798a7def17414907040825.jpg not downloaded yet
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_a847f598fb708debf3b954f06387ae95.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_a847f598fb708debf3b954f06387ae95.jpg not downloaded yet
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_4bb03d7c2e4fae9156de0d7cb4539d68.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_4bb03d7c2e4fae9156de0d7cb4539d68.jpg not downloaded yet
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF51839%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [auto1.de] INFO: Scrape type for HF51839: 0
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79074%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [auto1.de] INFO: Scrape type for EC79074: 0
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE20907%27 HTTP/1.1" 200 None
2026-03-28 18:42:53 [auto1.de] INFO: Scrape type for KE20907: 0
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-28 18:42:53 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM57049%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for ZM57049: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW41122%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for KW41122: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU16330%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for EU16330: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR88922%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for DR88922: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL55745%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for SL55745: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA61115%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for WA61115: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ49235%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for SJ49235: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT33018%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for BT33018: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT95165%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for KT95165: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX65004%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for JX65004: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG77732%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for VG77732: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW16405%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for MW16405: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY24352%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for BY24352: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV90594%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for SV90594: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN43056%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for CN43056: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA08562%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for RA08562: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL77757%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for EL77757: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ03639%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for MZ03639: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS45971%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for BS45971: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT95392%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [auto1.de] INFO: Scrape type for NT95392: 0
2026-03-28 18:42:54 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_c6616ccc578593114dd3d115bce0bd42.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_c6616ccc578593114dd3d115bce0bd42.jpg not downloaded yet
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_62d47b2e792c1aaa4c3bde7d00e99242.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_62d47b2e792c1aaa4c3bde7d00e99242.jpg not downloaded yet
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b28b710>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_9cf38972acbd6af2e2ff8155578fafef.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_9cf38972acbd6af2e2ff8155578fafef.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb8f1d0>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_5be9d50335dd535935d026c20579a14a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_5be9d50335dd535935d026c20579a14a.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b206f10>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_fefbf39486139b00525fdd74f123be32.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_fefbf39486139b00525fdd74f123be32.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05ad90>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_8e5d9444791f16ff88e6ff33ab6a8338.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_8e5d9444791f16ff88e6ff33ab6a8338.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b153d90>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_36cf94eb8b037f34626b1a146188b063.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_36cf94eb8b037f34626b1a146188b063.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b020210>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_b512a04f343f77397ef5007d218a7c9a.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_b512a04f343f77397ef5007d218a7c9a.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02f290>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_f5c360e39c6dc3ac5d33e4f8db17ef10.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_f5c360e39c6dc3ac5d33e4f8db17ef10.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b22da50>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_cd760494b54227ac2ad5821a6747e2de.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_cd760494b54227ac2ad5821a6747e2de.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbba050>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_99ffcb6d484cc670781f17c698d979a5.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_99ffcb6d484cc670781f17c698d979a5.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b022050>
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252Fb3%252F90b3279d0b50e30da910298bcf8aa445%252Fpa%252FGB90564_ff280136d0116b088d6afcac2e4e0ca8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_ff280136d0116b088d6afcac2e4e0ca8.jpg saved to cache
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f073838-314c-5126-b94c-d4da47a67f4f
2026-03-28 18:42:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f073838-314c-5126-b94c-d4da47a67f4f, skipping ID generation
2026-03-28 18:42:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f073838-314c-5126-b94c-d4da47a67f4f with scrape type 1
2026-03-28 18:42:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f073838-314c-5126-b94c-d4da47a67f4f sending to next pipeline
2026-03-28 18:42:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f073838-314c-5126-b94c-d4da47a67f4f, identifier: GB90564
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_db55391bfd41c3176b9f549ac0a1b5a6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_db55391bfd41c3176b9f549ac0a1b5a6.jpg not downloaded yet
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_789dd80f77df58c65c97f280068dad15.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_789dd80f77df58c65c97f280068dad15.jpg not downloaded yet
2026-03-28 18:42:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f073838-314c-5126-b94c-d4da47a67f4f with identifier: GB90564
2026-03-28 18:42:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f073838-314c-5126-b94c-d4da47a67f4f with identifier: GB90564
2026-03-28 18:42:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f073838-314c-5126-b94c-d4da47a67f4f with identifier: GB90564 to the API
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_ff280136d0116b088d6afcac2e4e0ca8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:58:42Z',
 'fuel_type': 'petrol',
 'id': '1f073838-314c-5126-b94c-d4da47a67f4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB90564',
 'listing': 'auction',
 'location': 'DE, Aschaffenburg',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 195676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89541,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_ff280136d0116b088d6afcac2e4e0ca8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75904,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_99ffcb6d484cc670781f17c698d979a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83578,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_f5c360e39c6dc3ac5d33e4f8db17ef10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_b512a04f343f77397ef5007d218a7c9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_fefbf39486139b00525fdd74f123be32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_0778adc8b390e71ef18721964a65a925.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_9cf38972acbd6af2e2ff8155578fafef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87751,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_8e5d9444791f16ff88e6ff33ab6a8338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_879b0ae2d7923d00473e378817cd45e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f073838-314c-5126-b94c-d4da47a67f4f/1f073838-314c-5126-b94c-d4da47a67f4f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/b3/90b3279d0b50e30da910298bcf8aa445/pa/GB90564_36cf94eb8b037f34626b1a146188b063.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-02-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2014}
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB90564%27 HTTP/1.1" 200 None
2026-03-28 18:42:55 [auto1.de] INFO: Saving data for GB90564: {'created_time': 1774723375.858418, 'last_price_update_time': 1774723375.85843, 'auction_closing_time': 1774886322.0}
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB90564') HTTP/1.1" 204 0
2026-03-28 18:42:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_126fdd9183f29d337fea59a8435ed0cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_126fdd9183f29d337fea59a8435ed0cd.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_e9ba3469bcb89a5f6afb21599855c7a0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_e9ba3469bcb89a5f6afb21599855c7a0.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_46909f89aaf697f7173f7532c3a19ee1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_46909f89aaf697f7173f7532c3a19ee1.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_ed3723d5465918a91397f0cf609969c3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_ed3723d5465918a91397f0cf609969c3.jpg not downloaded yet
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LD23223/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_3513da028ffbd66742eab3118451ec31.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_3513da028ffbd66742eab3118451ec31.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_63ec9cac1f40c22f7355b471f3e9a9b2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_63ec9cac1f40c22f7355b471f3e9a9b2.jpg not downloaded yet
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YD01023> (referer: https://www.auto1.com/v1/car-details-view/YD01023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ17275> (referer: https://www.auto1.com/v1/car-details-view/GZ17275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_077e8e93b7d7bbf8c6a6ad6d6f24370b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_077e8e93b7d7bbf8c6a6ad6d6f24370b.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_000d939e512b0e0e395d55a9b73d98b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_000d939e512b0e0e395d55a9b73d98b0.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_45d20eff12a86d8e78c6c321b6e85d6d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_45d20eff12a86d8e78c6c321b6e85d6d.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_8108e54d52185feccad6e3a9b4bd3d75.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_8108e54d52185feccad6e3a9b4bd3d75.jpg not downloaded yet
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_cdb5bc2a35502c87e49a83c417f844fd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_a847f598fb708debf3b954f06387ae95.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_2b358a6eeb5911396115943629f9e402.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_bb94361caa4fb360f4618a9c58b4a520.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_bb94361caa4fb360f4618a9c58b4a520.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_edfdc387e064f8e84e55bc30ea30baf5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_edfdc387e064f8e84e55bc30ea30baf5.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_8cf22f972e537ccf5a54816b42e4e20f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_8cf22f972e537ccf5a54816b42e4e20f.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_0edc7818ae52dbd5a0e2b286d576869f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_0edc7818ae52dbd5a0e2b286d576869f.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_855216542b5e81fcf59b112de8f3d8c7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_855216542b5e81fcf59b112de8f3d8c7.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_df804cc152b690112a5bc2d91dd2687d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_df804cc152b690112a5bc2d91dd2687d.jpg not downloaded yet
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_37c463276387149d54d0e0e83b19d82f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_e0cdc5cf120eaba78945973debf0d6b5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_e0cdc5cf120eaba78945973debf0d6b5.jpg not downloaded yet
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_9f9ef89074798a7def17414907040825.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_d73e651df79952a17a8a2d738259b99e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_d73e651df79952a17a8a2d738259b99e.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_5e82c8a8b5bf7121e81f00f6dc5ae7ff.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_5e82c8a8b5bf7121e81f00f6dc5ae7ff.jpg not downloaded yet
2026-03-28 18:42:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with identifier: YD01023
2026-03-28 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with scrape type 1
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_fa91a997b52be2f6524528b110d70b16.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_fa91a997b52be2f6524528b110d70b16.jpg not downloaded yet
2026-03-28 18:42:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with identifier: GZ17275
2026-03-28 18:42:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with scrape type 1
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_0a7d51cbf375f1403714fcb1dc53791e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_0a7d51cbf375f1403714fcb1dc53791e.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_b8c00541a991f19deb323e31c2721fa2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_b8c00541a991f19deb323e31c2721fa2.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_1ed3cf71382f9031ac6ca1ba6a1c8bec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_1ed3cf71382f9031ac6ca1ba6a1c8bec.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_76a6966c2a09510dd3b0a699457dc735.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_76a6966c2a09510dd3b0a699457dc735.jpg not downloaded yet
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b05b610>
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_cdb5bc2a35502c87e49a83c417f844fd.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_cdb5bc2a35502c87e49a83c417f844fd.jpg saved to cache
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb20a10>
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_a847f598fb708debf3b954f06387ae95.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_a847f598fb708debf3b954f06387ae95.jpg saved to cache
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd0ec50>
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_2b358a6eeb5911396115943629f9e402.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_2b358a6eeb5911396115943629f9e402.jpg saved to cache
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_f26eedc8f702f924c2ae3d52ca5b2dab.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_f26eedc8f702f924c2ae3d52ca5b2dab.jpg not downloaded yet
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_f8b2ace27188c60e1c41ab9cc46488dd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_0aad8fd59a3571f96201fc26c45d3fe3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_0aad8fd59a3571f96201fc26c45d3fe3.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_d84099acce1504f9c480265c2f3faa46.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_d84099acce1504f9c480265c2f3faa46.jpg not downloaded yet
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_ed3723d5465918a91397f0cf609969c3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b03d610>
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_37c463276387149d54d0e0e83b19d82f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_37c463276387149d54d0e0e83b19d82f.jpg saved to cache
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b00af90>
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_9f9ef89074798a7def17414907040825.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_9f9ef89074798a7def17414907040825.jpg saved to cache
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_46909f89aaf697f7173f7532c3a19ee1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_be7f763de04c7e23b8845ea3e5dc8403.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_be7f763de04c7e23b8845ea3e5dc8403.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_aab50c8bfbabc4351c3394444049eb7b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_aab50c8bfbabc4351c3394444049eb7b.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_e4b1722aa9c2b302f63b7b06e468fcf3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_e4b1722aa9c2b302f63b7b06e468fcf3.jpg not downloaded yet
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_69fc99a92179cbfbe3021b95449d61aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_69fc99a92179cbfbe3021b95449d61aa.jpg not downloaded yet
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbead90>
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_f8b2ace27188c60e1c41ab9cc46488dd.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_f8b2ace27188c60e1c41ab9cc46488dd.jpg saved to cache
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_4a3c52ea48f53d8da2f2889ee9a2b2b8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_4a3c52ea48f53d8da2f2889ee9a2b2b8.jpg not downloaded yet
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b19e250>
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_ed3723d5465918a91397f0cf609969c3.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_ed3723d5465918a91397f0cf609969c3.jpg saved to cache
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_8108e54d52185feccad6e3a9b4bd3d75.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d5bfd0>
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_46909f89aaf697f7173f7532c3a19ee1.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_46909f89aaf697f7173f7532c3a19ee1.jpg saved to cache
2026-03-28 18:42:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_a668be6e27c26cb41c5b28283c1b185f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_9a5dbb9a2e7a9daedfbc057eda0ff2cc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_45d20eff12a86d8e78c6c321b6e85d6d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_cdb2c00605465e0ee90b389f783321f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_4bb03d7c2e4fae9156de0d7cb4539d68.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_d849d981541dface4983a60247b1f8cf.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_e9ba3469bcb89a5f6afb21599855c7a0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_69fc99a92179cbfbe3021b95449d61aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc9afd0>
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_8108e54d52185feccad6e3a9b4bd3d75.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_8108e54d52185feccad6e3a9b4bd3d75.jpg saved to cache
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_d84099acce1504f9c480265c2f3faa46.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_4a3c52ea48f53d8da2f2889ee9a2b2b8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a79d0>
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_a668be6e27c26cb41c5b28283c1b185f.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_a668be6e27c26cb41c5b28283c1b185f.jpg saved to cache
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1093d0>
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga6%252F7d%252Fa67d73a5b65c7cce2cfa7c8e7e9604d3%252Fpa%252FKJ96076_9a5dbb9a2e7a9daedfbc057eda0ff2cc.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_9a5dbb9a2e7a9daedfbc057eda0ff2cc.jpg saved to cache
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32
2026-03-28 18:42:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32, skipping ID generation
2026-03-28 18:42:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with scrape type 1
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 sending to next pipeline
2026-03-28 18:42:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32, identifier: KJ96076
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c3a50>
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_45d20eff12a86d8e78c6c321b6e85d6d.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_45d20eff12a86d8e78c6c321b6e85d6d.jpg saved to cache
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b072390>
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_cdb2c00605465e0ee90b389f783321f7.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_cdb2c00605465e0ee90b389f783321f7.jpg saved to cache
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b075190>
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_4bb03d7c2e4fae9156de0d7cb4539d68.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_4bb03d7c2e4fae9156de0d7cb4539d68.jpg saved to cache
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:42:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0bea90>
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_d849d981541dface4983a60247b1f8cf.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_d849d981541dface4983a60247b1f8cf.jpg saved to cache
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0b1a10>
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_e9ba3469bcb89a5f6afb21599855c7a0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_e9ba3469bcb89a5f6afb21599855c7a0.jpg saved to cache
2026-03-28 18:42:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:42:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with identifier: KJ96076
2026-03-28 18:42:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with identifier: KJ96076
2026-03-28 18:42:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 041de9a2-fe34-5e7b-b8fe-4878cbf00c32 with identifier: KJ96076 to the API
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_9a5dbb9a2e7a9daedfbc057eda0ff2cc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 269,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.2L',
 'engine_horse_power': 243,
 'expiration_date': '2026-03-30T15:44:37Z',
 'fuel_type': 'petrol',
 'id': '041de9a2-fe34-5e7b-b8fe-4878cbf00c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ96076',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 194218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_a110e2b4024cdd1ba9258ce3bf2950cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99715,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_cd760494b54227ac2ad5821a6747e2de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2520109,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_9a5dbb9a2e7a9daedfbc057eda0ff2cc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_5be9d50335dd535935d026c20579a14a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_e8236371dc79a1f11ec96cfe9f2aa500.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_b02268d28f2cdaa5f33df5799555ac76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2435415,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_a668be6e27c26cb41c5b28283c1b185f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2505971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_937e8840737b020ddd4ca22c2b8df347.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_f44ae61065f1ba2d9d746c252732b7bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_041de9a2-fe34-5e7b-b8fe-4878cbf00c32/041de9a2-fe34-5e7b-b8fe-4878cbf00c32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2955469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga6/7d/a67d73a5b65c7cce2cfa7c8e7e9604d3/pa/KJ96076_52d3a08eb24f330c052c0ef78391327c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-09-06',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volvo XC90 3.2 R-Design Geartronic',
 'transmission': 'automatic',
 'trim': 'R-Design Geartronic',
 'year': 2010}
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ96076%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Saving data for KJ96076: {'created_time': 1774723378.368023, 'last_price_update_time': 1774723378.368035, 'auction_closing_time': 1774885477.0}
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ96076') HTTP/1.1" 204 0
2026-03-28 18:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_e4b1722aa9c2b302f63b7b06e468fcf3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_000d939e512b0e0e395d55a9b73d98b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_76a6966c2a09510dd3b0a699457dc735.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HE47734> (referer: https://www.auto1.com/v1/car-details-view/HE47734/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LD23223> (referer: https://www.auto1.com/v1/car-details-view/LD23223/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b58bd7910>
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_69fc99a92179cbfbe3021b95449d61aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_69fc99a92179cbfbe3021b95449d61aa.jpg saved to cache
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0107d0>
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_d84099acce1504f9c480265c2f3faa46.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_d84099acce1504f9c480265c2f3faa46.jpg saved to cache
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10edd0>
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_4a3c52ea48f53d8da2f2889ee9a2b2b8.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_4a3c52ea48f53d8da2f2889ee9a2b2b8.jpg saved to cache
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10eb50>
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_e4b1722aa9c2b302f63b7b06e468fcf3.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_e4b1722aa9c2b302f63b7b06e468fcf3.jpg saved to cache
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0b5310>
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_000d939e512b0e0e395d55a9b73d98b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_000d939e512b0e0e395d55a9b73d98b0.jpg saved to cache
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3f510>
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_76a6966c2a09510dd3b0a699457dc735.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_76a6966c2a09510dd3b0a699457dc735.jpg saved to cache
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d
2026-03-28 18:42:58 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 6009 | hits on page: 40
2026-03-28 18:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 557c44d2-c1a5-5925-b6aa-d7430ce6716b with identifier: HE47734
2026-03-28 18:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b with scrape type 1
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_a0e2232757c40dc774042addeb70f8f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a0e2232757c40dc774042addeb70f8f2.jpg not downloaded yet
2026-03-28 18:42:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-03-28 18:42:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with scrape type 1
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_80f53aad6e090cba69580ff82b382bc5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg not downloaded yet
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB20065%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for FB20065: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV73995%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for YV73995: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX55294%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for JX55294: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK93979%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for BK93979: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC65511%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for LC65511: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74164%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for NH74164: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG50140%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for CG50140: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL16347%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for YL16347: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN41763%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for MN41763: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55071%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for SY55071: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT57840%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for WT57840: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ34179%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for BZ34179: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ42240%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for GZ42240: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63249%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for DZ63249: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN76950%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for MN76950: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV46000%27 HTTP/1.1" 200 None
2026-03-28 18:42:58 [auto1.de] INFO: Scrape type for KV46000: 0
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-28 18:42:58 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-28 18:42:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA12646%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [auto1.de] INFO: Scrape type for TA12646: 0
2026-03-28 18:42:59 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-28 18:42:59 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB45550%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [auto1.de] INFO: Scrape type for LB45550: 0
2026-03-28 18:42:59 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG58612%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [auto1.de] INFO: Scrape type for VG58612: 0
2026-03-28 18:42:59 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC71395%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [auto1.de] INFO: Scrape type for YC71395: 0
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_e085b4d5443aa3895d17f242291ca762.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_e085b4d5443aa3895d17f242291ca762.jpg not downloaded yet
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_68a43070029f00b166f306be68c4e99c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_68a43070029f00b166f306be68c4e99c.jpg not downloaded yet
2026-03-28 18:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_0a7d51cbf375f1403714fcb1dc53791e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_b8c00541a991f19deb323e31c2721fa2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_aab50c8bfbabc4351c3394444049eb7b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_be7f763de04c7e23b8845ea3e5dc8403.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_0aad8fd59a3571f96201fc26c45d3fe3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_c12006b275fe6f592111c2027e7698e3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_c12006b275fe6f592111c2027e7698e3.jpg not downloaded yet
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_dea89f75e3a0cd91f5620811472fa068.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg not downloaded yet
2026-03-28 18:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_1ed3cf71382f9031ac6ca1ba6a1c8bec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_95ef2893d5489a5063d150f4868085c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_95ef2893d5489a5063d150f4868085c6.jpg not downloaded yet
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg not downloaded yet
2026-03-28 18:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_fa91a997b52be2f6524528b110d70b16.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_a154091a9fa33a54b63e76435e1d2f41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a154091a9fa33a54b63e76435e1d2f41.jpg not downloaded yet
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_d261e99c6119d7e383cb0818d14a14e5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_d261e99c6119d7e383cb0818d14a14e5.jpg not downloaded yet
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_e32e0568425f98633e73ecc8c623474b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_e32e0568425f98633e73ecc8c623474b.jpg not downloaded yet
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0b6810>
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_0a7d51cbf375f1403714fcb1dc53791e.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_0a7d51cbf375f1403714fcb1dc53791e.jpg saved to cache
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b00afd0>
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_b8c00541a991f19deb323e31c2721fa2.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_b8c00541a991f19deb323e31c2721fa2.jpg saved to cache
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0e3ed0>
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3a%252F7e%252F3a7ef802f41dc533437deba87da2786c%252Fpa%252FGZ17275_aab50c8bfbabc4351c3394444049eb7b.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_aab50c8bfbabc4351c3394444049eb7b.jpg saved to cache
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d
2026-03-28 18:42:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d, skipping ID generation
2026-03-28 18:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with scrape type 1
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d sending to next pipeline
2026-03-28 18:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d, identifier: GZ17275
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdb34d0>
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_be7f763de04c7e23b8845ea3e5dc8403.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_be7f763de04c7e23b8845ea3e5dc8403.jpg saved to cache
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b00e090>
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:42:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_0aad8fd59a3571f96201fc26c45d3fe3.jpg') HTTP/1.1" 204 0
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_0aad8fd59a3571f96201fc26c45d3fe3.jpg saved to cache
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_239eb5805a1964c36a79aedac876aa0f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_239eb5805a1964c36a79aedac876aa0f.jpg not downloaded yet
2026-03-28 18:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with identifier: GZ17275
2026-03-28 18:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with identifier: GZ17275
2026-03-28 18:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d with identifier: GZ17275 to the API
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_aab50c8bfbabc4351c3394444049eb7b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:48:52Z',
 'fuel_type': 'petrol',
 'id': '4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ17275',
 'listing': 'auction',
 'location': 'DE, Köln',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 197053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_0a7d51cbf375f1403714fcb1dc53791e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77370,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_76a6966c2a09510dd3b0a699457dc735.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76672,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_d84099acce1504f9c480265c2f3faa46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_aab50c8bfbabc4351c3394444049eb7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d/4ad9b5a4-5d68-58ce-ac02-ce3bbfa1c96d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81450,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3a/7e/3a7ef802f41dc533437deba87da2786c/pa/GZ17275_69fc99a92179cbfbe3021b95449d61aa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-06-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Style+',
 'transmission': 'manual',
 'trim': 'Style+',
 'year': 2010}
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ17275%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [auto1.de] INFO: Saving data for GZ17275: {'created_time': 1774723380.012788, 'last_price_update_time': 1774723380.012799, 'auction_closing_time': 1774885732.0}
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ17275') HTTP/1.1" 204 0
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_0edc7818ae52dbd5a0e2b286d576869f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_5e82c8a8b5bf7121e81f00f6dc5ae7ff.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_8cf22f972e537ccf5a54816b42e4e20f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_7c92d53e90a23d478cb80b14bf7db818.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_7c92d53e90a23d478cb80b14bf7db818.jpg not downloaded yet
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_9961b204e83f5487cd0472dc85617339.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_9961b204e83f5487cd0472dc85617339.jpg not downloaded yet
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be80e90>
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_1ed3cf71382f9031ac6ca1ba6a1c8bec.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_1ed3cf71382f9031ac6ca1ba6a1c8bec.jpg saved to cache
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7d810>
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252Fe8%252Fc6e8aaa301d4e99c68494849eacad830%252Fpa%252FYD01023_fa91a997b52be2f6524528b110d70b16.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_fa91a997b52be2f6524528b110d70b16.jpg saved to cache
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8
2026-03-28 18:43:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 200c8258-7a62-5b22-a7ef-bbff2816b7d8, skipping ID generation
2026-03-28 18:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with scrape type 1
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 200c8258-7a62-5b22-a7ef-bbff2816b7d8 sending to next pipeline
2026-03-28 18:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 200c8258-7a62-5b22-a7ef-bbff2816b7d8, identifier: YD01023
2026-03-28 18:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with identifier: YD01023
2026-03-28 18:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with identifier: YD01023
2026-03-28 18:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 200c8258-7a62-5b22-a7ef-bbff2816b7d8 with identifier: YD01023 to the API
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_fa91a997b52be2f6524528b110d70b16.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:30:38Z',
 'fuel_type': 'diesel',
 'id': '200c8258-7a62-5b22-a7ef-bbff2816b7d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YD01023',
 'listing': 'auction',
 'location': 'DE, Erfurt',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 252661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_fa91a997b52be2f6524528b110d70b16.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87582,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_1ed3cf71382f9031ac6ca1ba6a1c8bec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83150,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_0aad8fd59a3571f96201fc26c45d3fe3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_be7f763de04c7e23b8845ea3e5dc8403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125859,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_e4b1722aa9c2b302f63b7b06e468fcf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_200c8258-7a62-5b22-a7ef-bbff2816b7d8/200c8258-7a62-5b22-a7ef-bbff2816b7d8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/e8/c6e8aaa301d4e99c68494849eacad830/pa/YD01023_4a3c52ea48f53d8da2f2889ee9a2b2b8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD01023%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [auto1.de] INFO: Saving data for YD01023: {'created_time': 1774723380.82, 'last_price_update_time': 1774723380.820013, 'auction_closing_time': 1774884638.0}
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YD01023') HTTP/1.1" 204 0
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_edfdc387e064f8e84e55bc30ea30baf5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_214c42e2b376eb8179f3d187d5fdb2fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_214c42e2b376eb8179f3d187d5fdb2fa.jpg not downloaded yet
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a0e2232757c40dc774042addeb70f8f2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7eed0>
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_0edc7818ae52dbd5a0e2b286d576869f.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_0edc7818ae52dbd5a0e2b286d576869f.jpg saved to cache
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be82750>
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_5e82c8a8b5bf7121e81f00f6dc5ae7ff.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_5e82c8a8b5bf7121e81f00f6dc5ae7ff.jpg saved to cache
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbcde10>
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_8cf22f972e537ccf5a54816b42e4e20f.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_8cf22f972e537ccf5a54816b42e4e20f.jpg saved to cache
2026-03-28 18:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_68a43070029f00b166f306be68c4e99c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b295950>
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_edfdc387e064f8e84e55bc30ea30baf5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_edfdc387e064f8e84e55bc30ea30baf5.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bce41d0>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_80f53aad6e090cba69580ff82b382bc5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4befe2d0>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_a0e2232757c40dc774042addeb70f8f2.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a0e2232757c40dc774042addeb70f8f2.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_bb94361caa4fb360f4618a9c58b4a520.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0da110>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_68a43070029f00b166f306be68c4e99c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_68a43070029f00b166f306be68c4e99c.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-03-28 18:43:01 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_077e8e93b7d7bbf8c6a6ad6d6f24370b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW39146%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for SW39146: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS56268%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for SS56268: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM38388%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for HM38388: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA98041%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for SA98041: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS55924%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for HS55924: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM27503%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for RM27503: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB23451%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for GB23451: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD85387%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for GD85387: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW01608%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for NW01608: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY06085%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for TY06085: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23342%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for NU23342: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL62048%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for FL62048: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG84960%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for MG84960: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56806%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for KU56806: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB04799%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for YB04799: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME28341%27 HTTP/1.1" 200 None
2026-03-28 18:43:01 [auto1.de] INFO: Scrape type for ME28341: 0
2026-03-28 18:43:01 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_e32e0568425f98633e73ecc8c623474b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b19ee90>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_bb94361caa4fb360f4618a9c58b4a520.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_bb94361caa4fb360f4618a9c58b4a520.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b270e50>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_077e8e93b7d7bbf8c6a6ad6d6f24370b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_077e8e93b7d7bbf8c6a6ad6d6f24370b.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_df804cc152b690112a5bc2d91dd2687d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_d261e99c6119d7e383cb0818d14a14e5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_f26eedc8f702f924c2ae3d52ca5b2dab.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_855216542b5e81fcf59b112de8f3d8c7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_d73e651df79952a17a8a2d738259b99e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_e0cdc5cf120eaba78945973debf0d6b5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b00ffd0>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbcce50>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_e32e0568425f98633e73ecc8c623474b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_e32e0568425f98633e73ecc8c623474b.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_214c42e2b376eb8179f3d187d5fdb2fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_95ef2893d5489a5063d150f4868085c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_7c92d53e90a23d478cb80b14bf7db818.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc23650>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_df804cc152b690112a5bc2d91dd2687d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_df804cc152b690112a5bc2d91dd2687d.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_239eb5805a1964c36a79aedac876aa0f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_c12006b275fe6f592111c2027e7698e3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_9961b204e83f5487cd0472dc85617339.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_e085b4d5443aa3895d17f242291ca762.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a154091a9fa33a54b63e76435e1d2f41.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59d47810>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_d261e99c6119d7e383cb0818d14a14e5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_d261e99c6119d7e383cb0818d14a14e5.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-03-28 18:43:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be68050>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_f26eedc8f702f924c2ae3d52ca5b2dab.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_f26eedc8f702f924c2ae3d52ca5b2dab.jpg saved to cache
2026-03-28 18:43:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:43:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be68390>
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_855216542b5e81fcf59b112de8f3d8c7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_855216542b5e81fcf59b112de8f3d8c7.jpg saved to cache
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:43:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0e2550>
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_d73e651df79952a17a8a2d738259b99e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_d73e651df79952a17a8a2d738259b99e.jpg saved to cache
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:43:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0e1150>
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_e0cdc5cf120eaba78945973debf0d6b5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_e0cdc5cf120eaba78945973debf0d6b5.jpg saved to cache
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6b710>
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_214c42e2b376eb8179f3d187d5fdb2fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_214c42e2b376eb8179f3d187d5fdb2fa.jpg saved to cache
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b055790>
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_95ef2893d5489a5063d150f4868085c6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_95ef2893d5489a5063d150f4868085c6.jpg saved to cache
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b053b90>
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_7c92d53e90a23d478cb80b14bf7db818.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_7c92d53e90a23d478cb80b14bf7db818.jpg saved to cache
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0e3a10>
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fdf%252Fb4df4c0c1275a06500c0e2b5b2b4f0c6%252Fpa%252FLD23223_dea89f75e3a0cd91f5620811472fa068.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg saved to cache
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27
2026-03-28 18:43:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27, skipping ID generation
2026-03-28 18:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with scrape type 1
2026-03-28 18:43:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 sending to next pipeline
2026-03-28 18:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27, identifier: LD23223
2026-03-28 18:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-03-28 18:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223
2026-03-28 18:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbd2ab22-fdc4-50c3-bc3f-24b547e41b27 with identifier: LD23223 to the API
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:35:35Z',
 'fuel_type': 'petrol',
 'id': 'dbd2ab22-fdc4-50c3-bc3f-24b547e41b27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD23223',
 'listing': 'auction',
 'location': 'DE, Cham',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 106954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_80f53aad6e090cba69580ff82b382bc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_68a43070029f00b166f306be68c4e99c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_dea89f75e3a0cd91f5620811472fa068.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82851,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_52ac861e6855fbe5fe79f8beff3685fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dbd2ab22-fdc4-50c3-bc3f-24b547e41b27/dbd2ab22-fdc4-50c3-bc3f-24b547e41b27_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/df/b4df4c0c1275a06500c0e2b5b2b4f0c6/pa/LD23223_d261e99c6119d7e383cb0818d14a14e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 150 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2007}
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD23223%27 HTTP/1.1" 200 None
2026-03-28 18:43:03 [auto1.de] INFO: Saving data for LD23223: {'created_time': 1774723383.097966, 'last_price_update_time': 1774723383.097978, 'auction_closing_time': 1774884935.0}
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD23223') HTTP/1.1" 204 0
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc1e690>
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_239eb5805a1964c36a79aedac876aa0f.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_239eb5805a1964c36a79aedac876aa0f.jpg saved to cache
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0b9b90>
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_c12006b275fe6f592111c2027e7698e3.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_c12006b275fe6f592111c2027e7698e3.jpg saved to cache
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bce7310>
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_9961b204e83f5487cd0472dc85617339.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_9961b204e83f5487cd0472dc85617339.jpg saved to cache
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bce5c50>
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_e085b4d5443aa3895d17f242291ca762.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_e085b4d5443aa3895d17f242291ca762.jpg saved to cache
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bebe2d0>
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg73%252F81%252F73817396b10b633172b2e4143ce5e8e7%252Fpa%252FHE47734_a154091a9fa33a54b63e76435e1d2f41.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a154091a9fa33a54b63e76435e1d2f41.jpg saved to cache
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b
2026-03-28 18:43:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 557c44d2-c1a5-5925-b6aa-d7430ce6716b, skipping ID generation
2026-03-28 18:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b with scrape type 1
2026-03-28 18:43:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 557c44d2-c1a5-5925-b6aa-d7430ce6716b sending to next pipeline
2026-03-28 18:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 557c44d2-c1a5-5925-b6aa-d7430ce6716b, identifier: HE47734
2026-03-28 18:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 557c44d2-c1a5-5925-b6aa-d7430ce6716b with identifier: HE47734
2026-03-28 18:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 557c44d2-c1a5-5925-b6aa-d7430ce6716b with identifier: HE47734
2026-03-28 18:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 557c44d2-c1a5-5925-b6aa-d7430ce6716b with identifier: HE47734 to the API
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a154091a9fa33a54b63e76435e1d2f41.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:12Z',
 'fuel_type': 'diesel',
 'id': '557c44d2-c1a5-5925-b6aa-d7430ce6716b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE47734',
 'listing': 'auction',
 'location': 'DE, Hof',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 111873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82487,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a0e2232757c40dc774042addeb70f8f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_e085b4d5443aa3895d17f242291ca762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_c12006b275fe6f592111c2027e7698e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_95ef2893d5489a5063d150f4868085c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65047,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_a154091a9fa33a54b63e76435e1d2f41.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64512,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_e32e0568425f98633e73ecc8c623474b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_239eb5805a1964c36a79aedac876aa0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71744,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_7c92d53e90a23d478cb80b14bf7db818.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_9961b204e83f5487cd0472dc85617339.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_557c44d2-c1a5-5925-b6aa-d7430ce6716b/557c44d2-c1a5-5925-b6aa-d7430ce6716b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75225,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img73/81/73817396b10b633172b2e4143ce5e8e7/pa/HE47734_214c42e2b376eb8179f3d187d5fdb2fa.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2019}
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE47734%27 HTTP/1.1" 200 None
2026-03-28 18:43:03 [auto1.de] INFO: Saving data for HE47734: {'created_time': 1774723383.968228, 'last_price_update_time': 1774723383.968241, 'auction_closing_time': 1774882812.0}
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE47734') HTTP/1.1" 204 0
2026-03-28 18:43:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_62d47b2e792c1aaa4c3bde7d00e99242.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_f63a38bde8901f158c8ae92530845e2e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_db55391bfd41c3176b9f549ac0a1b5a6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_789dd80f77df58c65c97f280068dad15.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_3513da028ffbd66742eab3118451ec31.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_63ec9cac1f40c22f7355b471f3e9a9b2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_c6616ccc578593114dd3d115bce0bd42.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_126fdd9183f29d337fea59a8435ed0cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b049490>
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_62d47b2e792c1aaa4c3bde7d00e99242.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_62d47b2e792c1aaa4c3bde7d00e99242.jpg saved to cache
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:43:04 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0bb590>
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_f63a38bde8901f158c8ae92530845e2e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_f63a38bde8901f158c8ae92530845e2e.jpg saved to cache
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb50ad0>
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Feb%252F4eeb164f8174e0198093a436feca1811%252Fpa%252FEN09392_db55391bfd41c3176b9f549ac0a1b5a6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_db55391bfd41c3176b9f549ac0a1b5a6.jpg saved to cache
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947
2026-03-28 18:43:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947, skipping ID generation
2026-03-28 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with scrape type 1
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 sending to next pipeline
2026-03-28 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947, identifier: EN09392
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc22610>
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F19%252Fe41905d4b475fa48b837e215b9a1b1b5%252Fpa%252FSS01468_789dd80f77df58c65c97f280068dad15.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_789dd80f77df58c65c97f280068dad15.jpg saved to cache
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a74e390b-610e-54b1-b986-abaacfc03fee
2026-03-28 18:43:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a74e390b-610e-54b1-b986-abaacfc03fee, skipping ID generation
2026-03-28 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a74e390b-610e-54b1-b986-abaacfc03fee with scrape type 1
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a74e390b-610e-54b1-b986-abaacfc03fee sending to next pipeline
2026-03-28 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a74e390b-610e-54b1-b986-abaacfc03fee, identifier: SS01468
2026-03-28 18:43:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1fa690>
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_3513da028ffbd66742eab3118451ec31.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_3513da028ffbd66742eab3118451ec31.jpg saved to cache
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:43:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0b8cd0>
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgbb%252F09%252Fbb099452ccdd37882eedd1ea9ce71314%252Fpa%252FVX51529_63ec9cac1f40c22f7355b471f3e9a9b2.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_63ec9cac1f40c22f7355b471f3e9a9b2.jpg saved to cache
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8820817c-b125-54c0-a95f-1d9485e8fbcb
2026-03-28 18:43:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8820817c-b125-54c0-a95f-1d9485e8fbcb, skipping ID generation
2026-03-28 18:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8820817c-b125-54c0-a95f-1d9485e8fbcb with scrape type 1
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8820817c-b125-54c0-a95f-1d9485e8fbcb sending to next pipeline
2026-03-28 18:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8820817c-b125-54c0-a95f-1d9485e8fbcb, identifier: VX51529
2026-03-28 18:43:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb9c790>
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_c6616ccc578593114dd3d115bce0bd42.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_c6616ccc578593114dd3d115bce0bd42.jpg saved to cache
2026-03-28 18:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with identifier: EN09392
2026-03-28 18:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with identifier: EN09392
2026-03-28 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9a2a92d-6904-56f2-bcfa-5fdb7ca08947 with identifier: EN09392 to the API
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_db55391bfd41c3176b9f549ac0a1b5a6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 214,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 4',
 'engine': '1.8L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:41:06Z',
 'fuel_type': 'petrol',
 'id': 'd9a2a92d-6904-56f2-bcfa-5fdb7ca08947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN09392',
 'listing': 'auction',
 'location': 'DE, Bremerhaven',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 249309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104635,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_2b358a6eeb5911396115943629f9e402.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101095,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_a847f598fb708debf3b954f06387ae95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_db55391bfd41c3176b9f549ac0a1b5a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_46909f89aaf697f7173f7532c3a19ee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d9a2a92d-6904-56f2-bcfa-5fdb7ca08947/d9a2a92d-6904-56f2-bcfa-5fdb7ca08947_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 151314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/eb/4eeb164f8174e0198093a436feca1811/pa/EN09392_077e8e93b7d7bbf8c6a6ad6d6f24370b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 200 Kompressor Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2004}
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN09392%27 HTTP/1.1" 200 None
2026-03-28 18:43:05 [auto1.de] INFO: Saving data for EN09392: {'created_time': 1774723385.282832, 'last_price_update_time': 1774723385.282843, 'auction_closing_time': 1774885266.0}
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN09392') HTTP/1.1" 204 0
2026-03-28 18:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a74e390b-610e-54b1-b986-abaacfc03fee with identifier: SS01468
2026-03-28 18:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a74e390b-610e-54b1-b986-abaacfc03fee with identifier: SS01468
2026-03-28 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a74e390b-610e-54b1-b986-abaacfc03fee with identifier: SS01468 to the API
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_789dd80f77df58c65c97f280068dad15.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:41:10Z',
 'fuel_type': 'diesel',
 'id': 'a74e390b-610e-54b1-b986-abaacfc03fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS01468',
 'listing': 'auction',
 'location': 'DE, Magdeburg',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 189092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_cdb5bc2a35502c87e49a83c417f844fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3133961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_4bb03d7c2e4fae9156de0d7cb4539d68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_789dd80f77df58c65c97f280068dad15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_ed3723d5465918a91397f0cf609969c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88858,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_000d939e512b0e0e395d55a9b73d98b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_bb94361caa4fb360f4618a9c58b4a520.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63141,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_0edc7818ae52dbd5a0e2b286d576869f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3099877,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_e0cdc5cf120eaba78945973debf0d6b5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_b8c00541a991f19deb323e31c2721fa2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a74e390b-610e-54b1-b986-abaacfc03fee/a74e390b-610e-54b1-b986-abaacfc03fee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3157492,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/19/e41905d4b475fa48b837e215b9a1b1b5/pa/SS01468_f26eedc8f702f924c2ae3d52ca5b2dab.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Ambiente',
 'transmission': 'manual',
 'trim': 'quattro Ambiente',
 'year': 2012}
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS01468%27 HTTP/1.1" 200 None
2026-03-28 18:43:05 [auto1.de] INFO: Saving data for SS01468: {'created_time': 1774723385.701221, 'last_price_update_time': 1774723385.701233, 'auction_closing_time': 1774885270.0}
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS01468') HTTP/1.1" 204 0
2026-03-28 18:43:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8820817c-b125-54c0-a95f-1d9485e8fbcb with identifier: VX51529
2026-03-28 18:43:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8820817c-b125-54c0-a95f-1d9485e8fbcb with identifier: VX51529
2026-03-28 18:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8820817c-b125-54c0-a95f-1d9485e8fbcb with identifier: VX51529 to the API
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_63ec9cac1f40c22f7355b471f3e9a9b2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:47Z',
 'fuel_type': 'petrol',
 'id': '8820817c-b125-54c0-a95f-1d9485e8fbcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX51529',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 64095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2901482,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_d849d981541dface4983a60247b1f8cf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_f8b2ace27188c60e1c41ab9cc46488dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_9f9ef89074798a7def17414907040825.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61248,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_62d47b2e792c1aaa4c3bde7d00e99242.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_e9ba3469bcb89a5f6afb21599855c7a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2945627,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_63ec9cac1f40c22f7355b471f3e9a9b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_8108e54d52185feccad6e3a9b4bd3d75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_8cf22f972e537ccf5a54816b42e4e20f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2900461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_df804cc152b690112a5bc2d91dd2687d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8820817c-b125-54c0-a95f-1d9485e8fbcb/8820817c-b125-54c0-a95f-1d9485e8fbcb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbb/09/bb099452ccdd37882eedd1ea9ce71314/pa/VX51529_5e82c8a8b5bf7121e81f00f6dc5ae7ff.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-09-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2021}
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX51529%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Saving data for VX51529: {'created_time': 1774723386.110846, 'last_price_update_time': 1774723386.110857, 'auction_closing_time': 1774884587.0}
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX51529') HTTP/1.1" 204 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU10222%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for AU10222: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN75028%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for MN75028: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB90605%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for SB90605: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL93382%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for HL93382: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU71027%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for HU71027: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93754%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for HW93754: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB68023%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for NB68023: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG93361%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for BG93361: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV32018%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for ZV32018: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64289%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for FT64289: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE10146%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for KE10146: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64243%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for PN64243: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH57282%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for WH57282: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE82228%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for SE82228: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY49257%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for ZY49257: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG18082%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for PG18082: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX47645%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for VX47645: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV18863%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for BV18863: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE38410%27 HTTP/1.1" 200 None
2026-03-28 18:43:06 [auto1.de] INFO: Scrape type for HE38410: 0
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-28 18:43:06 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RN07993> (referer: https://www.auto1.com/v1/car-details-view/RN07993/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ24427> (referer: https://www.auto1.com/v1/car-details-view/MJ24427/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC95910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB32219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM06899/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK05104> (referer: https://www.auto1.com/v1/car-details-view/KK05104/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MW28967/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1c9d90>
2026-03-28 18:43:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7d%252Ffe%252F7dfe021cb5e35d8eee8bcc17c5169bea%252Fpa%252FDT06996_126fdd9183f29d337fea59a8435ed0cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_126fdd9183f29d337fea59a8435ed0cd.jpg saved to cache
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a18af995-1367-5cd1-8126-b25ff08bf268
2026-03-28 18:43:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a18af995-1367-5cd1-8126-b25ff08bf268, skipping ID generation
2026-03-28 18:43:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a18af995-1367-5cd1-8126-b25ff08bf268 with scrape type 1
2026-03-28 18:43:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a18af995-1367-5cd1-8126-b25ff08bf268 sending to next pipeline
2026-03-28 18:43:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a18af995-1367-5cd1-8126-b25ff08bf268, identifier: DT06996
2026-03-28 18:43:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a18af995-1367-5cd1-8126-b25ff08bf268 with identifier: DT06996
2026-03-28 18:43:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a18af995-1367-5cd1-8126-b25ff08bf268 with identifier: DT06996
2026-03-28 18:43:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a18af995-1367-5cd1-8126-b25ff08bf268 with identifier: DT06996 to the API
2026-03-28 18:43:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_126fdd9183f29d337fea59a8435ed0cd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:24:10Z',
 'fuel_type': 'petrol',
 'id': 'a18af995-1367-5cd1-8126-b25ff08bf268',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT06996',
 'listing': 'auction',
 'location': 'DE, Neufahrn',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 202259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_f63a38bde8901f158c8ae92530845e2e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2479943,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_cdb2c00605465e0ee90b389f783321f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60561,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_37c463276387149d54d0e0e83b19d82f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2482871,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_c6616ccc578593114dd3d115bce0bd42.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503201,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_126fdd9183f29d337fea59a8435ed0cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2034123,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_3513da028ffbd66742eab3118451ec31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_45d20eff12a86d8e78c6c321b6e85d6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_edfdc387e064f8e84e55bc30ea30baf5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2439246,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_855216542b5e81fcf59b112de8f3d8c7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a18af995-1367-5cd1-8126-b25ff08bf268/a18af995-1367-5cd1-8126-b25ff08bf268_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img7d/fe/7dfe021cb5e35d8eee8bcc17c5169bea/pa/DT06996_d73e651df79952a17a8a2d738259b99e.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 Comfort 2WD',
 'transmission': 'manual',
 'trim': 'Comfort 2WD',
 'year': 2013}
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT06996%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [auto1.de] INFO: Saving data for DT06996: {'created_time': 1774723387.219365, 'last_price_update_time': 1774723387.219376, 'auction_closing_time': 1774884250.0}
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT06996') HTTP/1.1" 204 0
2026-03-28 18:43:07 [scrapy.extensions.logstats] INFO: Crawled 594 pages (at 79 pages/min), scraped 772 items (at 58 items/min)
2026-03-28 18:43:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 193MiB
2026-03-28 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8042c6c-14c5-53cf-b99b-24640a085134 with identifier: RN07993
2026-03-28 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8042c6c-14c5-53cf-b99b-24640a085134 with scrape type 1
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_32e5171fbf6b4526014fff0a8730f8d3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_32e5171fbf6b4526014fff0a8730f8d3.jpg not downloaded yet
2026-03-28 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95a52ebb-76ba-5711-a917-7df9da57d602 with identifier: MJ24427
2026-03-28 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a52ebb-76ba-5711-a917-7df9da57d602 with scrape type 1
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 95a52ebb-76ba-5711-a917-7df9da57d602
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_a2282cbe4642f9e9700e67ea5ddac96e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_a2282cbe4642f9e9700e67ea5ddac96e.jpg not downloaded yet
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_9d3711bf6c873c400809d62cbd9245b9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_9d3711bf6c873c400809d62cbd9245b9.jpg not downloaded yet
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_15e43cdb592cc478fa93b5dd31ef2083.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_15e43cdb592cc478fa93b5dd31ef2083.jpg not downloaded yet
2026-03-28 18:43:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH85097/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb66549c-160f-57cf-b1cd-ae1ce605bd0f with identifier: KK05104
2026-03-28 18:43:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb66549c-160f-57cf-b1cd-ae1ce605bd0f with scrape type 1
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fb66549c-160f-57cf-b1cd-ae1ce605bd0f
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7c%252Fad7ca5f7de34e165b68c2123e69be6d6%252Fpa%252FKK05104_ae1c40b80a1555b739e09034fb9a33b7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_ae1c40b80a1555b739e09034fb9a33b7.jpg already downloaded
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7c%252Fad7ca5f7de34e165b68c2123e69be6d6%252Fpa%252FKK05104_c9f97eb59a4d0e2d0bf23dee2750c592.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_c9f97eb59a4d0e2d0bf23dee2750c592.jpg already downloaded
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7c%252Fad7ca5f7de34e165b68c2123e69be6d6%252Fpa%252FKK05104_6f9b2f1198fe34e94793c8941cb86e8d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_6f9b2f1198fe34e94793c8941cb86e8d.jpg already downloaded
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7c%252Fad7ca5f7de34e165b68c2123e69be6d6%252Fpa%252FKK05104_17a0c27ea393d1318e2629ea83670f24.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_17a0c27ea393d1318e2629ea83670f24.jpg already downloaded
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F7c%252Fad7ca5f7de34e165b68c2123e69be6d6%252Fpa%252FKK05104_12875dde461a528ea0bbfa8a4a64156e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_12875dde461a528ea0bbfa8a4a64156e.jpg already downloaded
2026-03-28 18:43:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb66549c-160f-57cf-b1cd-ae1ce605bd0f, identifier: KK05104
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_49969dfc6ae823cbb6599e2d69609b5f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_49969dfc6ae823cbb6599e2d69609b5f.jpg not downloaded yet
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_90a72c87611a665295345fca50735d62.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_90a72c87611a665295345fca50735d62.jpg not downloaded yet
2026-03-28 18:43:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb66549c-160f-57cf-b1cd-ae1ce605bd0f with identifier: KK05104
2026-03-28 18:43:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb66549c-160f-57cf-b1cd-ae1ce605bd0f with identifier: KK05104
2026-03-28 18:43:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb66549c-160f-57cf-b1cd-ae1ce605bd0f with identifier: KK05104 to the API
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KK05104>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:04:10Z',
 'fuel_type': 'diesel',
 'id': 'fb66549c-160f-57cf-b1cd-ae1ce605bd0f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK05104',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 305601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_ae1c40b80a1555b739e09034fb9a33b7.jpg',
                'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_c9f97eb59a4d0e2d0bf23dee2750c592.jpg',
                'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_6f9b2f1198fe34e94793c8941cb86e8d.jpg',
                'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_17a0c27ea393d1318e2629ea83670f24.jpg',
                'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_12875dde461a528ea0bbfa8a4a64156e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb66549c-160f-57cf-b1cd-ae1ce605bd0f/fb66549c-160f-57cf-b1cd-ae1ce605bd0f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_ae1c40b80a1555b739e09034fb9a33b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb66549c-160f-57cf-b1cd-ae1ce605bd0f/fb66549c-160f-57cf-b1cd-ae1ce605bd0f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_c9f97eb59a4d0e2d0bf23dee2750c592.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb66549c-160f-57cf-b1cd-ae1ce605bd0f/fb66549c-160f-57cf-b1cd-ae1ce605bd0f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_6f9b2f1198fe34e94793c8941cb86e8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb66549c-160f-57cf-b1cd-ae1ce605bd0f/fb66549c-160f-57cf-b1cd-ae1ce605bd0f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_17a0c27ea393d1318e2629ea83670f24.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb66549c-160f-57cf-b1cd-ae1ce605bd0f/fb66549c-160f-57cf-b1cd-ae1ce605bd0f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104235,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/7c/ad7ca5f7de34e165b68c2123e69be6d6/pa/KK05104_12875dde461a528ea0bbfa8a4a64156e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Elegance',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2014}
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK05104%27 HTTP/1.1" 200 None
2026-03-28 18:43:07 [auto1.de] INFO: Saving data for KK05104: {'created_time': 1774723387.982026, 'last_price_update_time': 1774723387.98204, 'auction_closing_time': 1774883050.0}
2026-03-28 18:43:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK05104') HTTP/1.1" 204 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_27894b1dcf459ac2d66ecd45e80ff159.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_27894b1dcf459ac2d66ecd45e80ff159.jpg not downloaded yet
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_8cc264c6587b5bfecbf9478ef87f748d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_8cc264c6587b5bfecbf9478ef87f748d.jpg not downloaded yet
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_02be3c56e1871cf222a40ba6b6e15449.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_02be3c56e1871cf222a40ba6b6e15449.jpg not downloaded yet
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_4832419e5a28678b29c0d2aff2ce191f.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_4832419e5a28678b29c0d2aff2ce191f.jpg not downloaded yet
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_473971aa1103fa96531b76de645c6ccc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_473971aa1103fa96531b76de645c6ccc.jpg not downloaded yet
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_32e5171fbf6b4526014fff0a8730f8d3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_9d3711bf6c873c400809d62cbd9245b9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_a2282cbe4642f9e9700e67ea5ddac96e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_eb33d8a58047fa56b398dab9477ef401.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_eb33d8a58047fa56b398dab9477ef401.jpg not downloaded yet
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_15e43cdb592cc478fa93b5dd31ef2083.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_a544105a7aa577da6dbde6a875d28072.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_a544105a7aa577da6dbde6a875d28072.jpg not downloaded yet
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_21ebca7e44b648ac9e223fba5ae1dd8c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_21ebca7e44b648ac9e223fba5ae1dd8c.jpg not downloaded yet
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_1e07b94a17fc99632ce4bf03e3997058.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_1e07b94a17fc99632ce4bf03e3997058.jpg not downloaded yet
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_4832419e5a28678b29c0d2aff2ce191f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bba9ad0>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_32e5171fbf6b4526014fff0a8730f8d3.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_32e5171fbf6b4526014fff0a8730f8d3.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd6a650>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_9d3711bf6c873c400809d62cbd9245b9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_9d3711bf6c873c400809d62cbd9245b9.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59fdfc50>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_a2282cbe4642f9e9700e67ea5ddac96e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_a2282cbe4642f9e9700e67ea5ddac96e.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 95a52ebb-76ba-5711-a917-7df9da57d602
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb61e90>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_15e43cdb592cc478fa93b5dd31ef2083.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_15e43cdb592cc478fa93b5dd31ef2083.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 95a52ebb-76ba-5711-a917-7df9da57d602
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0ba150>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_4832419e5a28678b29c0d2aff2ce191f.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_4832419e5a28678b29c0d2aff2ce191f.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 95a52ebb-76ba-5711-a917-7df9da57d602
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_473971aa1103fa96531b76de645c6ccc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_21ebca7e44b648ac9e223fba5ae1dd8c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_a544105a7aa577da6dbde6a875d28072.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcf1c90>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_473971aa1103fa96531b76de645c6ccc.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_473971aa1103fa96531b76de645c6ccc.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_02be3c56e1871cf222a40ba6b6e15449.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF76211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b009190>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_21ebca7e44b648ac9e223fba5ae1dd8c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_21ebca7e44b648ac9e223fba5ae1dd8c.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd7b010>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_a544105a7aa577da6dbde6a875d28072.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_a544105a7aa577da6dbde6a875d28072.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_eb33d8a58047fa56b398dab9477ef401.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_8cc264c6587b5bfecbf9478ef87f748d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN96283> (referer: https://www.auto1.com/v1/car-details-view/PN96283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ10370/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0115d0>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_02be3c56e1871cf222a40ba6b6e15449.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_02be3c56e1871cf222a40ba6b6e15449.jpg saved to cache
2026-03-28 18:43:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY65257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_90a72c87611a665295345fca50735d62.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN00284/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK32140> (referer: https://www.auto1.com/v1/car-details-view/EK32140/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7bc50>
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_eb33d8a58047fa56b398dab9477ef401.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_eb33d8a58047fa56b398dab9477ef401.jpg saved to cache
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b052b50>
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_8cc264c6587b5bfecbf9478ef87f748d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_8cc264c6587b5bfecbf9478ef87f748d.jpg saved to cache
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 95a52ebb-76ba-5711-a917-7df9da57d602
2026-03-28 18:43:09 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with identifier: PN96283
2026-03-28 18:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with scrape type 1
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_4024f9bb3162f8a8f4be9826feb4220c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_4024f9bb3162f8a8f4be9826feb4220c.jpg not downloaded yet
2026-03-28 18:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_1e07b94a17fc99632ce4bf03e3997058.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC00182%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for YC00182: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ11771%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for KZ11771: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ16589%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for HJ16589: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM53361%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for KM53361: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU74458%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for PU74458: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK23311%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for NK23311: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP69948%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for HP69948: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: YJ19312
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19312%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for YJ19312: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE48651%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for NE48651: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA78869%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for BA78869: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ78015%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for DJ78015: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM71650%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for SM71650: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU52934%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for ZU52934: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW89679%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for PW89679: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD61279%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [auto1.de] INFO: Scrape type for GD61279: 0
2026-03-28 18:43:09 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_3e7b483181fe95fb7f0919e1d76e0c3b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_3e7b483181fe95fb7f0919e1d76e0c3b.jpg not downloaded yet
2026-03-28 18:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_49969dfc6ae823cbb6599e2d69609b5f.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE21106> (referer: https://www.auto1.com/v1/car-details-view/CE21106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_5f2a7d5635ac0e9bc9f13d3d6d1a4ef9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_5f2a7d5635ac0e9bc9f13d3d6d1a4ef9.jpg not downloaded yet
2026-03-28 18:43:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd30b10>
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg45%252Fa3%252F45a35d7ebcff2a56100241cf50551f8e%252Fpa%252FMJ24427_90a72c87611a665295345fca50735d62.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_90a72c87611a665295345fca50735d62.jpg saved to cache
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 95a52ebb-76ba-5711-a917-7df9da57d602
2026-03-28 18:43:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 95a52ebb-76ba-5711-a917-7df9da57d602, skipping ID generation
2026-03-28 18:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95a52ebb-76ba-5711-a917-7df9da57d602 with scrape type 1
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 95a52ebb-76ba-5711-a917-7df9da57d602 sending to next pipeline
2026-03-28 18:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95a52ebb-76ba-5711-a917-7df9da57d602, identifier: MJ24427
2026-03-28 18:43:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with identifier: EK32140
2026-03-28 18:43:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with scrape type 1
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_364aee6486acdff16f6ff85a54183847.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_364aee6486acdff16f6ff85a54183847.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_90dc2f5ad536c85aa3673e690f1fb433.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_90dc2f5ad536c85aa3673e690f1fb433.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_07cd39fdee2d2bebf248717dc2c28426.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_07cd39fdee2d2bebf248717dc2c28426.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_3b499d3332d969950b6378ca43bb5ba0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_3b499d3332d969950b6378ca43bb5ba0.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_ee1795ef74031f4d2e4c8117c5844729.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_ee1795ef74031f4d2e4c8117c5844729.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_4c9d40b0656b94542cc51c0414027cf4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_4c9d40b0656b94542cc51c0414027cf4.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_5055f6bda375459b915dfbbd64600b32.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_5055f6bda375459b915dfbbd64600b32.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_407ae4805b342a89ad3828123669ca7c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_407ae4805b342a89ad3828123669ca7c.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_605b4d571b127d087b395abd370b797c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_605b4d571b127d087b395abd370b797c.jpg already downloaded
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb4%252Fc7%252Fb4c7b4f66d5c07a55b9c70f8abcce2db%252Fpa%252FEK32140_854b396901105716339ad23b9ea49b38.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_854b396901105716339ad23b9ea49b38.jpg already downloaded
2026-03-28 18:43:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a, identifier: EK32140
2026-03-28 18:43:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b008410>
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_1e07b94a17fc99632ce4bf03e3997058.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_1e07b94a17fc99632ce4bf03e3997058.jpg saved to cache
2026-03-28 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_4cbf926fba1c74a39f893ef296d3f78e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_4cbf926fba1c74a39f893ef296d3f78e.jpg not downloaded yet
2026-03-28 18:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95a52ebb-76ba-5711-a917-7df9da57d602 with identifier: MJ24427
2026-03-28 18:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95a52ebb-76ba-5711-a917-7df9da57d602 with identifier: MJ24427
2026-03-28 18:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95a52ebb-76ba-5711-a917-7df9da57d602 with identifier: MJ24427 to the API
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_90a72c87611a665295345fca50735d62.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '2.1L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:19:29Z',
 'fuel_type': 'diesel',
 'id': '95a52ebb-76ba-5711-a917-7df9da57d602',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ24427',
 'listing': 'auction',
 'location': 'DE, Oldenburg',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 344007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_a2282cbe4642f9e9700e67ea5ddac96e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_15e43cdb592cc478fa93b5dd31ef2083.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_90a72c87611a665295345fca50735d62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_8cc264c6587b5bfecbf9478ef87f748d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_95a52ebb-76ba-5711-a917-7df9da57d602/95a52ebb-76ba-5711-a917-7df9da57d602_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img45/a3/45a35d7ebcff2a56100241cf50551f8e/pa/MJ24427_4832419e5a28678b29c0d2aff2ce191f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-10-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CDI Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2004}
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ24427%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [auto1.de] INFO: Saving data for MJ24427: {'created_time': 1774723390.514443, 'last_price_update_time': 1774723390.514455, 'auction_closing_time': 1774883969.0}
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ24427') HTTP/1.1" 204 0
2026-03-28 18:43:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with identifier: EK32140
2026-03-28 18:43:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with identifier: EK32140
2026-03-28 18:43:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a with identifier: EK32140 to the API
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK32140>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'category': 'Rental',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:46Z',
 'fuel_type': 'petrol',
 'id': '5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK32140',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 164957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_364aee6486acdff16f6ff85a54183847.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_90dc2f5ad536c85aa3673e690f1fb433.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_07cd39fdee2d2bebf248717dc2c28426.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_3b499d3332d969950b6378ca43bb5ba0.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_ee1795ef74031f4d2e4c8117c5844729.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_4c9d40b0656b94542cc51c0414027cf4.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_5055f6bda375459b915dfbbd64600b32.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_407ae4805b342a89ad3828123669ca7c.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_605b4d571b127d087b395abd370b797c.jpg',
                'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_854b396901105716339ad23b9ea49b38.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_364aee6486acdff16f6ff85a54183847.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_90dc2f5ad536c85aa3673e690f1fb433.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59250,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_07cd39fdee2d2bebf248717dc2c28426.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_3b499d3332d969950b6378ca43bb5ba0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_ee1795ef74031f4d2e4c8117c5844729.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_4c9d40b0656b94542cc51c0414027cf4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_5055f6bda375459b915dfbbd64600b32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_407ae4805b342a89ad3828123669ca7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_605b4d571b127d087b395abd370b797c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a/5d5443ad-fcdb-5a26-86fa-8a5f255f1b9a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39652,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb4/c7/b4c7b4f66d5c07a55b9c70f8abcce2db/pa/EK32140_854b396901105716339ad23b9ea49b38.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-07-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.5 TSI ACT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK32140%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [auto1.de] INFO: Saving data for EK32140: {'created_time': 1774723390.951827, 'last_price_update_time': 1774723390.951842, 'auction_closing_time': 1774883206.0}
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK32140') HTTP/1.1" 204 0
2026-03-28 18:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_4024f9bb3162f8a8f4be9826feb4220c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_add594e61b5e03e91ec773a42abf344b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_add594e61b5e03e91ec773a42abf344b.jpg not downloaded yet
2026-03-28 18:43:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MW28967> (referer: https://www.auto1.com/v1/car-details-view/MW28967/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC95910> (referer: https://www.auto1.com/v1/car-details-view/YC95910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB32219> (referer: https://www.auto1.com/v1/car-details-view/ZB32219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0bb850>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_49969dfc6ae823cbb6599e2d69609b5f.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_49969dfc6ae823cbb6599e2d69609b5f.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3534d46-2d46-50dd-bb70-8f487d14215f with identifier: CE21106
2026-03-28 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3534d46-2d46-50dd-bb70-8f487d14215f with scrape type 1
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_e5c6fc85353bde7e700938f7663d5cd5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_e5c6fc85353bde7e700938f7663d5cd5.jpg not downloaded yet
2026-03-28 18:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_ad74f7d9e8f4fd19ae3afe26fbb2bf58.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_ad74f7d9e8f4fd19ae3afe26fbb2bf58.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_57e5da13f37695b2dcf2dc8a4168eed4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_57e5da13f37695b2dcf2dc8a4168eed4.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_60991ba450aab4401daed8c8a4d6bace.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_60991ba450aab4401daed8c8a4d6bace.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_51d1151d1b1d35f8a6a8cf670e70b375.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_51d1151d1b1d35f8a6a8cf670e70b375.jpg not downloaded yet
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0c63d0>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_4024f9bb3162f8a8f4be9826feb4220c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_4024f9bb3162f8a8f4be9826feb4220c.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_3e7b483181fe95fb7f0919e1d76e0c3b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_ac76e9cc0cda95e56dea33b9011c6e9e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_ac76e9cc0cda95e56dea33b9011c6e9e.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_8c82402cf0d6511ef8afe64edc2aa7f7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_8c82402cf0d6511ef8afe64edc2aa7f7.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_5f2a7d5635ac0e9bc9f13d3d6d1a4ef9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2b8b493-d5d3-526c-9c44-5b4e339bd048 with identifier: MW28967
2026-03-28 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b8b493-d5d3-526c-9c44-5b4e339bd048 with scrape type 1
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_031cf6237dca52b9ce88ebe40d972973.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_031cf6237dca52b9ce88ebe40d972973.jpg not downloaded yet
2026-03-28 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8e32792-4605-5aab-bd58-73b082afd91c with identifier: YC95910
2026-03-28 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e32792-4605-5aab-bd58-73b082afd91c with scrape type 1
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e8e32792-4605-5aab-bd58-73b082afd91c
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_02b82adea75ddd5d9d45f28903d01b0c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_02b82adea75ddd5d9d45f28903d01b0c.jpg not downloaded yet
2026-03-28 18:43:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with identifier: ZB32219
2026-03-28 18:43:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with scrape type 1
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_f44120fc8297ae47883e511f8c777771.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_f44120fc8297ae47883e511f8c777771.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_4cbf926fba1c74a39f893ef296d3f78e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_8d721f82afdd9c3bc768d6db227c9b50.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_8d721f82afdd9c3bc768d6db227c9b50.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_c65158a8fcbe0c4d2f3ceede7af766ec.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_c65158a8fcbe0c4d2f3ceede7af766ec.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_add594e61b5e03e91ec773a42abf344b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_ddfb2daa9d43c89fd420f4a26d19c85c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_ddfb2daa9d43c89fd420f4a26d19c85c.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_32baca9b10e5203df9e4baf85d8096fa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_32baca9b10e5203df9e4baf85d8096fa.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_bb539196d659a2b68502e4c2b1b33be7.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_bb539196d659a2b68502e4c2b1b33be7.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_ad74f7d9e8f4fd19ae3afe26fbb2bf58.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_dcd6aeb14adf68b39c42711d6902cbdd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_dcd6aeb14adf68b39c42711d6902cbdd.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_4aea5d195cd2cbc6ea98e5b78722756a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_4aea5d195cd2cbc6ea98e5b78722756a.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_57e5da13f37695b2dcf2dc8a4168eed4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_69a526451ebdb82c936e32884dbeddc3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_69a526451ebdb82c936e32884dbeddc3.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_6dc8550ae9cfb275bf3de7356936c2d8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_6dc8550ae9cfb275bf3de7356936c2d8.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_d982af50cc97adc33fb18545aba0997b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_d982af50cc97adc33fb18545aba0997b.jpg not downloaded yet
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b067790>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_3e7b483181fe95fb7f0919e1d76e0c3b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_3e7b483181fe95fb7f0919e1d76e0c3b.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc4d7d0>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_5f2a7d5635ac0e9bc9f13d3d6d1a4ef9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_5f2a7d5635ac0e9bc9f13d3d6d1a4ef9.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_67d5d30dc29c818b6aa0936b12ec15c4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_67d5d30dc29c818b6aa0936b12ec15c4.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_60991ba450aab4401daed8c8a4d6bace.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_3a81efd0211e924f231c252f6b36dbd0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_3a81efd0211e924f231c252f6b36dbd0.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_dc6ea07e55a027880c31ccb587612214.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_dc6ea07e55a027880c31ccb587612214.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_9967af3edec9657f665ead5ecb74db6a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_9967af3edec9657f665ead5ecb74db6a.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_ac76e9cc0cda95e56dea33b9011c6e9e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_86be8f82aa946b2d88c3495e39158095.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_86be8f82aa946b2d88c3495e39158095.jpg not downloaded yet
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b095890>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_4cbf926fba1c74a39f893ef296d3f78e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_4cbf926fba1c74a39f893ef296d3f78e.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc4f490>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_add594e61b5e03e91ec773a42abf344b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_add594e61b5e03e91ec773a42abf344b.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1f9ad0>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_ad74f7d9e8f4fd19ae3afe26fbb2bf58.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_ad74f7d9e8f4fd19ae3afe26fbb2bf58.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdf21d0>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_57e5da13f37695b2dcf2dc8a4168eed4.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_57e5da13f37695b2dcf2dc8a4168eed4.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_02a603796b563a15d1567fb61958504a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_02a603796b563a15d1567fb61958504a.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_c205f9df8836f7e01b390e1566e681cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_c205f9df8836f7e01b390e1566e681cd.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_66b539b11acd75abbdaccb4ab11704d5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_66b539b11acd75abbdaccb4ab11704d5.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_f44120fc8297ae47883e511f8c777771.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_a214f6c9c7277479592599c42c6258fb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_a214f6c9c7277479592599c42c6258fb.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_bb539196d659a2b68502e4c2b1b33be7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_57053635fa11ab8e6a3e444caa719331.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_57053635fa11ab8e6a3e444caa719331.jpg not downloaded yet
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_7d57dc53cd2f4d72d2360ca5ec4e7700.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_7d57dc53cd2f4d72d2360ca5ec4e7700.jpg not downloaded yet
2026-03-28 18:43:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM06899> (referer: https://www.auto1.com/v1/car-details-view/ZM06899/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1fbf50>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_60991ba450aab4401daed8c8a4d6bace.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_60991ba450aab4401daed8c8a4d6bace.jpg saved to cache
2026-03-28 18:43:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0b4650>
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_ac76e9cc0cda95e56dea33b9011c6e9e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_ac76e9cc0cda95e56dea33b9011c6e9e.jpg saved to cache
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_e6a373d56be463f282ed63e630670f5e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_e6a373d56be463f282ed63e630670f5e.jpg not downloaded yet
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF76211> (referer: https://www.auto1.com/v1/car-details-view/VF76211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_03d970be6462f28f0c044d397c555a00.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_03d970be6462f28f0c044d397c555a00.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_819deef9e667f5c7715087b69e883a2a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_819deef9e667f5c7715087b69e883a2a.jpg not downloaded yet
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_32baca9b10e5203df9e4baf85d8096fa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH85097> (referer: https://www.auto1.com/v1/car-details-view/LH85097/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc8add0>
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_f44120fc8297ae47883e511f8c777771.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_f44120fc8297ae47883e511f8c777771.jpg saved to cache
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcbb490>
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_bb539196d659a2b68502e4c2b1b33be7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_bb539196d659a2b68502e4c2b1b33be7.jpg saved to cache
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_d3e7b5bba0071cc70d77db45e95512be.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_d3e7b5bba0071cc70d77db45e95512be.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_006f49f459179af656f8baa248e76b89.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_006f49f459179af656f8baa248e76b89.jpg not downloaded yet
2026-03-28 18:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b423cfae-7005-5f07-b731-6e9c53046033 with identifier: ZM06899
2026-03-28 18:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b423cfae-7005-5f07-b731-6e9c53046033 with scrape type 1
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_08720b985bbf112f6baac80475e08dfb.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_08720b985bbf112f6baac80475e08dfb.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_d5aa5cf8f617c1261653d28a196c39c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_d5aa5cf8f617c1261653d28a196c39c8.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_c538bede52b85622ef95470029b6279d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_c538bede52b85622ef95470029b6279d.jpg not downloaded yet
2026-03-28 18:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5fffb58-66ff-5e60-8e46-6ff376aeea6d with identifier: VF76211
2026-03-28 18:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d with scrape type 1
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_b1ae3af46ce90c2aca6f956375b59776.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_b1ae3af46ce90c2aca6f956375b59776.jpg not downloaded yet
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_d982af50cc97adc33fb18545aba0997b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_0675eba44a7336206f1a96f38a665371.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_0675eba44a7336206f1a96f38a665371.jpg not downloaded yet
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_66b539b11acd75abbdaccb4ab11704d5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_79f6d7963c0925903beee33434999f2c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_79f6d7963c0925903beee33434999f2c.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_e3f4f464c8827ef63df2e0c330430187.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_e3f4f464c8827ef63df2e0c330430187.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_12e36bf8a891350ca43d1b1d5271354e.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_12e36bf8a891350ca43d1b1d5271354e.jpg not downloaded yet
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ10370> (referer: https://www.auto1.com/v1/car-details-view/DZ10370/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:12 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0c5d90>
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_32baca9b10e5203df9e4baf85d8096fa.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_32baca9b10e5203df9e4baf85d8096fa.jpg saved to cache
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8e32792-4605-5aab-bd58-73b082afd91c
2026-03-28 18:43:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d24f0af8-a244-5ea5-b6ac-830616b12c25 with identifier: LH85097
2026-03-28 18:43:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24f0af8-a244-5ea5-b6ac-830616b12c25 with scrape type 1
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_814cd1986795696304b1c5b9b0de45aa.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_814cd1986795696304b1c5b9b0de45aa.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_b5887857fc53aa07cb29184ad207c7e6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_b5887857fc53aa07cb29184ad207c7e6.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_1f4fb71ae00c6e0714234a2a29844b9d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_1f4fb71ae00c6e0714234a2a29844b9d.jpg not downloaded yet
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU32415%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for KU32415: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG84191%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for NG84191: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX99567%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for UX99567: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR86923%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for SR86923: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX68256%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for ZX68256: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ39134%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for CZ39134: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU15499%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for EU15499: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG48100%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for HG48100: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA68058%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for WA68058: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ05971%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for RZ05971: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL73605%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for VL73605: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ58013%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for TZ58013: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG73872%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for MG73872: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM35826%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for RM35826: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH57829%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for EH57829: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR42785%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for GR42785: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM73538%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for MM73538: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH24505%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for AH24505: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF00811%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for RF00811: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA70430%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for CA70430: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ56926%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for AZ56926: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY33643%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [auto1.de] INFO: Scrape type for GY33643: 0
2026-03-28 18:43:12 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_6416269b9852388d2e03a8c4eef73726.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_6416269b9852388d2e03a8c4eef73726.jpg not downloaded yet
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_c205f9df8836f7e01b390e1566e681cd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_d4264ddce79a84bc82557df6fd735ad6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_d4264ddce79a84bc82557df6fd735ad6.jpg not downloaded yet
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN00284> (referer: https://www.auto1.com/v1/car-details-view/AN00284/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_450a2720664ae0c9ea72e08c39f96b41.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_450a2720664ae0c9ea72e08c39f96b41.jpg not downloaded yet
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_213379a41bff6502c0764ef1b14440f9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_213379a41bff6502c0764ef1b14440f9.jpg not downloaded yet
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_e6a373d56be463f282ed63e630670f5e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_a214f6c9c7277479592599c42c6258fb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_af356e4842f51cec0402018e211700d9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_af356e4842f51cec0402018e211700d9.jpg not downloaded yet
2026-03-28 18:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY65257> (referer: https://www.auto1.com/v1/car-details-view/RY65257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b04a390>
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_d982af50cc97adc33fb18545aba0997b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_d982af50cc97adc33fb18545aba0997b.jpg saved to cache
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb64cd0>
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_66b539b11acd75abbdaccb4ab11704d5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_66b539b11acd75abbdaccb4ab11704d5.jpg saved to cache
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37e7a81e-885a-58ca-b008-40a84d9e4b32 with identifier: DZ10370
2026-03-28 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37e7a81e-885a-58ca-b008-40a84d9e4b32 with scrape type 1
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_63c84328f4bb5c17a9158680076418a3.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_63c84328f4bb5c17a9158680076418a3.jpg not downloaded yet
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_33280478285649c7ae9bb57c21c3c423.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_33280478285649c7ae9bb57c21c3c423.jpg not downloaded yet
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_5f470f1e66bf8313db1bba459bccd471.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_5f470f1e66bf8313db1bba459bccd471.jpg not downloaded yet
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_52f04335df97424042329c5ff228c8c9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_52f04335df97424042329c5ff228c8c9.jpg not downloaded yet
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_1ac91d0235d7b789c00d5bb9e9622790.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1ac91d0235d7b789c00d5bb9e9622790.jpg not downloaded yet
2026-03-28 18:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_27894b1dcf459ac2d66ecd45e80ff159.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_7d57dc53cd2f4d72d2360ca5ec4e7700.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_8a1cdd89cb799b27366af281408da02b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_8a1cdd89cb799b27366af281408da02b.jpg not downloaded yet
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_3503013644ab7cf6543813a691e7eb87.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_3503013644ab7cf6543813a691e7eb87.jpg not downloaded yet
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17e290>
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_c205f9df8836f7e01b390e1566e681cd.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_c205f9df8836f7e01b390e1566e681cd.jpg saved to cache
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8e32792-4605-5aab-bd58-73b082afd91c
2026-03-28 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1838e078-9202-574f-a0d2-2bccab21f7bb with identifier: AN00284
2026-03-28 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1838e078-9202-574f-a0d2-2bccab21f7bb with scrape type 1
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1838e078-9202-574f-a0d2-2bccab21f7bb
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_640a120ebc582de923a0bc8ffc72df32.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_640a120ebc582de923a0bc8ffc72df32.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_9a92cd181ed1659b77f0bc12383f4a39.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_9a92cd181ed1659b77f0bc12383f4a39.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_2023d6dcb49f4592a5f9e880b9a3e296.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_2023d6dcb49f4592a5f9e880b9a3e296.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_05294bc5eb9aa05420f18d5ebbe06cdc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_05294bc5eb9aa05420f18d5ebbe06cdc.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_0eee2d93ac0ae3e29c0dc522ea0564cd.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_0eee2d93ac0ae3e29c0dc522ea0564cd.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_5bb66ad0e3e54271374f3674f4d4327b.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_5bb66ad0e3e54271374f3674f4d4327b.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_38f32f23df0b68017fb21e7e94ffc2c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_38f32f23df0b68017fb21e7e94ffc2c8.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_0faf01437ba708448203641bcff4488d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_0faf01437ba708448203641bcff4488d.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_b07b0dd9a7d9b62a4329b6f6d03887f2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_b07b0dd9a7d9b62a4329b6f6d03887f2.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Ff1%252F89f1760294566566c47bbdb0bbf0c39c%252Fpa%252FAN00284_2fc4058902e66d543e0f93ba4bcdd079.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_2fc4058902e66d543e0f93ba4bcdd079.jpg already downloaded
2026-03-28 18:43:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1838e078-9202-574f-a0d2-2bccab21f7bb, identifier: AN00284
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2f94d0>
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_e6a373d56be463f282ed63e630670f5e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_e6a373d56be463f282ed63e630670f5e.jpg saved to cache
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b5a5f2d50>
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_a214f6c9c7277479592599c42c6258fb.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_a214f6c9c7277479592599c42c6258fb.jpg saved to cache
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b24c05-11e5-5389-929d-d36e6041ed73 with identifier: RY65257
2026-03-28 18:43:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b24c05-11e5-5389-929d-d36e6041ed73 with scrape type 1
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 10b24c05-11e5-5389-929d-d36e6041ed73
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F54%252F0354bc1128bb405e1d34374550c9b2d7%252Fpa%252FRY65257_dace5c98a867bcb7e4a96144ff016408.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_dace5c98a867bcb7e4a96144ff016408.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F54%252F0354bc1128bb405e1d34374550c9b2d7%252Fpa%252FRY65257_518674feba8312cbd5e69bd842520a91.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_518674feba8312cbd5e69bd842520a91.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F54%252F0354bc1128bb405e1d34374550c9b2d7%252Fpa%252FRY65257_ad0af4c4bf5a3fd74645e097f30a6e39.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_ad0af4c4bf5a3fd74645e097f30a6e39.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F54%252F0354bc1128bb405e1d34374550c9b2d7%252Fpa%252FRY65257_2789a5cbe7ddb64245f29f94d2616985.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_2789a5cbe7ddb64245f29f94d2616985.jpg already downloaded
2026-03-28 18:43:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F54%252F0354bc1128bb405e1d34374550c9b2d7%252Fpa%252FRY65257_c4d7e7f96d8735edf6ad280425ea075c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_c4d7e7f96d8735edf6ad280425ea075c.jpg already downloaded
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg03%252F54%252F0354bc1128bb405e1d34374550c9b2d7%252Fpa%252FRY65257_c9868a55754a1099881b24ccd7a37781.png%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_c9868a55754a1099881b24ccd7a37781.png already downloaded
2026-03-28 18:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10b24c05-11e5-5389-929d-d36e6041ed73, identifier: RY65257
2026-03-28 18:43:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_57053635fa11ab8e6a3e444caa719331.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_15e1bba84e54b2afb7ae67e123b7b82d.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_15e1bba84e54b2afb7ae67e123b7b82d.jpg not downloaded yet
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_1ecb82ce5b2455997f90e75164a4bae5.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1ecb82ce5b2455997f90e75164a4bae5.jpg not downloaded yet
2026-03-28 18:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1838e078-9202-574f-a0d2-2bccab21f7bb with identifier: AN00284
2026-03-28 18:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1838e078-9202-574f-a0d2-2bccab21f7bb with identifier: AN00284
2026-03-28 18:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1838e078-9202-574f-a0d2-2bccab21f7bb with identifier: AN00284 to the API
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AN00284>
{'auction_title': '',
 'c_o_2_emission_value': 246,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:14:06Z',
 'fuel_type': 'petrol',
 'id': '1838e078-9202-574f-a0d2-2bccab21f7bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN00284',
 'listing': 'auction',
 'location': 'DE, Hameln',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 104119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_640a120ebc582de923a0bc8ffc72df32.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_9a92cd181ed1659b77f0bc12383f4a39.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_2023d6dcb49f4592a5f9e880b9a3e296.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_05294bc5eb9aa05420f18d5ebbe06cdc.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_0eee2d93ac0ae3e29c0dc522ea0564cd.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_5bb66ad0e3e54271374f3674f4d4327b.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_38f32f23df0b68017fb21e7e94ffc2c8.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_0faf01437ba708448203641bcff4488d.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_b07b0dd9a7d9b62a4329b6f6d03887f2.jpg',
                'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_2fc4058902e66d543e0f93ba4bcdd079.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2635255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_640a120ebc582de923a0bc8ffc72df32.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2608851,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_9a92cd181ed1659b77f0bc12383f4a39.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2744574,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_2023d6dcb49f4592a5f9e880b9a3e296.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2381465,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_05294bc5eb9aa05420f18d5ebbe06cdc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2578002,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_0eee2d93ac0ae3e29c0dc522ea0564cd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73777,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_5bb66ad0e3e54271374f3674f4d4327b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2207485,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_38f32f23df0b68017fb21e7e94ffc2c8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_0faf01437ba708448203641bcff4488d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2535114,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_b07b0dd9a7d9b62a4329b6f6d03887f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1838e078-9202-574f-a0d2-2bccab21f7bb/1838e078-9202-574f-a0d2-2bccab21f7bb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2800873,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/f1/89f1760294566566c47bbdb0bbf0c39c/pa/AN00284_2fc4058902e66d543e0f93ba4bcdd079.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-11-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 280 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2008}
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN00284%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [auto1.de] INFO: Saving data for AN00284: {'created_time': 1774723394.493522, 'last_price_update_time': 1774723394.493533, 'auction_closing_time': 1774883646.0}
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN00284') HTTP/1.1" 204 0
2026-03-28 18:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10b24c05-11e5-5389-929d-d36e6041ed73 with identifier: RY65257
2026-03-28 18:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10b24c05-11e5-5389-929d-d36e6041ed73 with identifier: RY65257
2026-03-28 18:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10b24c05-11e5-5389-929d-d36e6041ed73 with identifier: RY65257 to the API
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY65257>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '2.2L',
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:30:34Z',
 'fuel_type': 'diesel',
 'id': '10b24c05-11e5-5389-929d-d36e6041ed73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY65257',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 324722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_dace5c98a867bcb7e4a96144ff016408.jpg',
                'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_518674feba8312cbd5e69bd842520a91.jpg',
                'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_ad0af4c4bf5a3fd74645e097f30a6e39.jpg',
                'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_2789a5cbe7ddb64245f29f94d2616985.jpg',
                'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_c4d7e7f96d8735edf6ad280425ea075c.jpg',
                'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_c9868a55754a1099881b24ccd7a37781.png'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b24c05-11e5-5389-929d-d36e6041ed73/10b24c05-11e5-5389-929d-d36e6041ed73_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126911,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_dace5c98a867bcb7e4a96144ff016408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b24c05-11e5-5389-929d-d36e6041ed73/10b24c05-11e5-5389-929d-d36e6041ed73_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 139341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_518674feba8312cbd5e69bd842520a91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b24c05-11e5-5389-929d-d36e6041ed73/10b24c05-11e5-5389-929d-d36e6041ed73_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_ad0af4c4bf5a3fd74645e097f30a6e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b24c05-11e5-5389-929d-d36e6041ed73/10b24c05-11e5-5389-929d-d36e6041ed73_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_2789a5cbe7ddb64245f29f94d2616985.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b24c05-11e5-5389-929d-d36e6041ed73/10b24c05-11e5-5389-929d-d36e6041ed73_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_c4d7e7f96d8735edf6ad280425ea075c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_10b24c05-11e5-5389-929d-d36e6041ed73/10b24c05-11e5-5389-929d-d36e6041ed73_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 216824,
             'Height': 192,
             'OriginUrl': 'https://img-pa.auto1.com/img03/54/0354bc1128bb405e1d34374550c9b2d7/pa/RY65257_c9868a55754a1099881b24ccd7a37781.png',
             'Width': 442}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-10',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ford Galaxy 2.2 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY65257%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [auto1.de] INFO: Saving data for RY65257: {'created_time': 1774723394.948112, 'last_price_update_time': 1774723394.948124, 'auction_closing_time': 1774884634.0}
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY65257') HTTP/1.1" 204 0
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_c9ec14c20457c2c58ed13cf8d1f11a56.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_c9ec14c20457c2c58ed13cf8d1f11a56.jpg not downloaded yet
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_caf227d499e47d72a5215c5dbaf061f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_caf227d499e47d72a5215c5dbaf061f4.jpg not downloaded yet
2026-03-28 18:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_819deef9e667f5c7715087b69e883a2a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_e0f50bb00b22bfc06907f7ea2df206c8.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_e0f50bb00b22bfc06907f7ea2df206c8.jpg not downloaded yet
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_5e925a4fe546a40783aea5a5c6f2a9a2.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_5e925a4fe546a40783aea5a5c6f2a9a2.jpg not downloaded yet
2026-03-28 18:43:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b097750>
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F9a%252F779a8423a12c5d882af7f72044657969%252Fpa%252FRN07993_27894b1dcf459ac2d66ecd45e80ff159.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_27894b1dcf459ac2d66ecd45e80ff159.jpg saved to cache
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8042c6c-14c5-53cf-b99b-24640a085134
2026-03-28 18:43:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8042c6c-14c5-53cf-b99b-24640a085134, skipping ID generation
2026-03-28 18:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8042c6c-14c5-53cf-b99b-24640a085134 with scrape type 1
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8042c6c-14c5-53cf-b99b-24640a085134 sending to next pipeline
2026-03-28 18:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8042c6c-14c5-53cf-b99b-24640a085134, identifier: RN07993
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbeb590>
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_7d57dc53cd2f4d72d2360ca5ec4e7700.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_7d57dc53cd2f4d72d2360ca5ec4e7700.jpg saved to cache
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_c538bede52b85622ef95470029b6279d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_a04ccb53429da876803fe3b8685c4e9c.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_a04ccb53429da876803fe3b8685c4e9c.jpg not downloaded yet
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_7602558bc5296962806e22028fbc2042.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_7602558bc5296962806e22028fbc2042.jpg not downloaded yet
2026-03-28 18:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8042c6c-14c5-53cf-b99b-24640a085134 with identifier: RN07993
2026-03-28 18:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8042c6c-14c5-53cf-b99b-24640a085134 with identifier: RN07993
2026-03-28 18:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8042c6c-14c5-53cf-b99b-24640a085134 with identifier: RN07993 to the API
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_27894b1dcf459ac2d66ecd45e80ff159.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:17:42Z',
 'fuel_type': 'petrol',
 'id': 'e8042c6c-14c5-53cf-b99b-24640a085134',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN07993',
 'listing': 'auction',
 'location': 'DE, Trier',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 130976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86367,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_32e5171fbf6b4526014fff0a8730f8d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74317,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_9d3711bf6c873c400809d62cbd9245b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_49969dfc6ae823cbb6599e2d69609b5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2892066,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_27894b1dcf459ac2d66ecd45e80ff159.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3292758,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_02be3c56e1871cf222a40ba6b6e15449.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047409,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_473971aa1103fa96531b76de645c6ccc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_eb33d8a58047fa56b398dab9477ef401.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_a544105a7aa577da6dbde6a875d28072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88372,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_21ebca7e44b648ac9e223fba5ae1dd8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8042c6c-14c5-53cf-b99b-24640a085134/e8042c6c-14c5-53cf-b99b-24640a085134_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3159194,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/9a/779a8423a12c5d882af7f72044657969/pa/RN07993_1e07b94a17fc99632ce4bf03e3997058.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 X-TRA',
 'transmission': 'manual',
 'trim': 'X-TRA',
 'year': 2017}
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN07993%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [auto1.de] INFO: Saving data for RN07993: {'created_time': 1774723395.758094, 'last_price_update_time': 1774723395.758109, 'auction_closing_time': 1774883862.0}
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN07993') HTTP/1.1" 204 0
2026-03-28 18:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_814cd1986795696304b1c5b9b0de45aa.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_2747eb6b543eea6217562a3475538aa9.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_2747eb6b543eea6217562a3475538aa9.jpg not downloaded yet
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_4472458c64d5d18620bb794e48a0b607.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_4472458c64d5d18620bb794e48a0b607.jpg not downloaded yet
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2715d0>
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_57053635fa11ab8e6a3e444caa719331.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_57053635fa11ab8e6a3e444caa719331.jpg saved to cache
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_b5887857fc53aa07cb29184ad207c7e6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_b86461fb5464a5c107370a43b0bf90dc.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_b86461fb5464a5c107370a43b0bf90dc.jpg not downloaded yet
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_6105f4b9f57eca49dfd794376c3db4c6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_6105f4b9f57eca49dfd794376c3db4c6.jpg not downloaded yet
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b19c550>
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_819deef9e667f5c7715087b69e883a2a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_819deef9e667f5c7715087b69e883a2a.jpg saved to cache
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_d4264ddce79a84bc82557df6fd735ad6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_ae6fb381ba9e52302121b676110089b0.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_ae6fb381ba9e52302121b676110089b0.jpg not downloaded yet
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_f1c7375c3c12f41458e780c2b965acd6.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_f1c7375c3c12f41458e780c2b965acd6.jpg not downloaded yet
2026-03-28 18:43:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_b1ae3af46ce90c2aca6f956375b59776.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_668470d234c23376e5aaa84e2d33f29a.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_668470d234c23376e5aaa84e2d33f29a.jpg not downloaded yet
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_47a156aa4990106001319f0cea453465.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_47a156aa4990106001319f0cea453465.jpg not downloaded yet
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10a890>
2026-03-28 18:43:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_c538bede52b85622ef95470029b6279d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_c538bede52b85622ef95470029b6279d.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_6416269b9852388d2e03a8c4eef73726.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_ee74a3b7874a000a8381a73f5fac93f4.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_ee74a3b7874a000a8381a73f5fac93f4.jpg not downloaded yet
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_7fb5ea983bad4c9302cbbc7a54ecc7e1.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_7fb5ea983bad4c9302cbbc7a54ecc7e1.jpg not downloaded yet
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_6b2603a3bff39b5ace53d2cd563a2617.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_6b2603a3bff39b5ace53d2cd563a2617.jpg not downloaded yet
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc7c390>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_814cd1986795696304b1c5b9b0de45aa.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_814cd1986795696304b1c5b9b0de45aa.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b02f450>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_b5887857fc53aa07cb29184ad207c7e6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_b5887857fc53aa07cb29184ad207c7e6.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be7e310>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_d4264ddce79a84bc82557df6fd735ad6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_d4264ddce79a84bc82557df6fd735ad6.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_1f4fb71ae00c6e0714234a2a29844b9d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_213379a41bff6502c0764ef1b14440f9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_1007a7e1bee40909dec34f5955ca2c13.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1007a7e1bee40909dec34f5955ca2c13.jpg not downloaded yet
2026-03-28 18:43:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbcdad0>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_b1ae3af46ce90c2aca6f956375b59776.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_b1ae3af46ce90c2aca6f956375b59776.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd32190>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_6416269b9852388d2e03a8c4eef73726.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_6416269b9852388d2e03a8c4eef73726.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_33280478285649c7ae9bb57c21c3c423.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_31f092d1708cbf056dcb3b0248c92c71.jpg%27 HTTP/1.1" 200 None
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_31f092d1708cbf056dcb3b0248c92c71.jpg not downloaded yet
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b00ed90>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_1f4fb71ae00c6e0714234a2a29844b9d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_1f4fb71ae00c6e0714234a2a29844b9d.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbab510>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_213379a41bff6502c0764ef1b14440f9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_213379a41bff6502c0764ef1b14440f9.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_e5c6fc85353bde7e700938f7663d5cd5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_51d1151d1b1d35f8a6a8cf670e70b375.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1ac91d0235d7b789c00d5bb9e9622790.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_caf227d499e47d72a5215c5dbaf061f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_8c82402cf0d6511ef8afe64edc2aa7f7.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc30810>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_33280478285649c7ae9bb57c21c3c423.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_33280478285649c7ae9bb57c21c3c423.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1ecb82ce5b2455997f90e75164a4bae5.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_b86461fb5464a5c107370a43b0bf90dc.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_67d5d30dc29c818b6aa0936b12ec15c4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_6105f4b9f57eca49dfd794376c3db4c6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_5f470f1e66bf8313db1bba459bccd471.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_7fb5ea983bad4c9302cbbc7a54ecc7e1.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b59ff5a90>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_e5c6fc85353bde7e700938f7663d5cd5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_e5c6fc85353bde7e700938f7663d5cd5.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0e1f10>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_51d1151d1b1d35f8a6a8cf670e70b375.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_51d1151d1b1d35f8a6a8cf670e70b375.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcbbc90>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_1ac91d0235d7b789c00d5bb9e9622790.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1ac91d0235d7b789c00d5bb9e9622790.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd15b50>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_caf227d499e47d72a5215c5dbaf061f4.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_caf227d499e47d72a5215c5dbaf061f4.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd3dd90>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_8c82402cf0d6511ef8afe64edc2aa7f7.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_8c82402cf0d6511ef8afe64edc2aa7f7.jpg saved to cache
2026-03-28 18:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb9890>
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_1ecb82ce5b2455997f90e75164a4bae5.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1ecb82ce5b2455997f90e75164a4bae5.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b059150>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_b86461fb5464a5c107370a43b0bf90dc.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_b86461fb5464a5c107370a43b0bf90dc.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bcb9390>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_67d5d30dc29c818b6aa0936b12ec15c4.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_67d5d30dc29c818b6aa0936b12ec15c4.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be72450>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_6105f4b9f57eca49dfd794376c3db4c6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_6105f4b9f57eca49dfd794376c3db4c6.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb63e50>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_5f470f1e66bf8313db1bba459bccd471.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_5f470f1e66bf8313db1bba459bccd471.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b219bd0>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_7fb5ea983bad4c9302cbbc7a54ecc7e1.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_7fb5ea983bad4c9302cbbc7a54ecc7e1.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_6b2603a3bff39b5ace53d2cd563a2617.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_7602558bc5296962806e22028fbc2042.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1007a7e1bee40909dec34f5955ca2c13.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_5e925a4fe546a40783aea5a5c6f2a9a2.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_f1c7375c3c12f41458e780c2b965acd6.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_668470d234c23376e5aaa84e2d33f29a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_47a156aa4990106001319f0cea453465.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_2747eb6b543eea6217562a3475538aa9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_ae6fb381ba9e52302121b676110089b0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_e0f50bb00b22bfc06907f7ea2df206c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0b35d0>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_6b2603a3bff39b5ace53d2cd563a2617.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_6b2603a3bff39b5ace53d2cd563a2617.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_15e1bba84e54b2afb7ae67e123b7b82d.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0d8190>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_7602558bc5296962806e22028fbc2042.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_7602558bc5296962806e22028fbc2042.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd80110>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_1007a7e1bee40909dec34f5955ca2c13.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1007a7e1bee40909dec34f5955ca2c13.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b216410>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_5e925a4fe546a40783aea5a5c6f2a9a2.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_5e925a4fe546a40783aea5a5c6f2a9a2.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b008c50>
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_f1c7375c3c12f41458e780c2b965acd6.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_f1c7375c3c12f41458e780c2b965acd6.jpg saved to cache
2026-03-28 18:43:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_c9ec14c20457c2c58ed13cf8d1f11a56.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_8a1cdd89cb799b27366af281408da02b.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_31f092d1708cbf056dcb3b0248c92c71.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b053f50>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_668470d234c23376e5aaa84e2d33f29a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_668470d234c23376e5aaa84e2d33f29a.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1796d0>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_47a156aa4990106001319f0cea453465.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_47a156aa4990106001319f0cea453465.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b010390>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_2747eb6b543eea6217562a3475538aa9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_2747eb6b543eea6217562a3475538aa9.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b013cd0>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_ae6fb381ba9e52302121b676110089b0.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_ae6fb381ba9e52302121b676110089b0.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be47190>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_e0f50bb00b22bfc06907f7ea2df206c8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_e0f50bb00b22bfc06907f7ea2df206c8.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2f8310>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_15e1bba84e54b2afb7ae67e123b7b82d.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_15e1bba84e54b2afb7ae67e123b7b82d.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_af356e4842f51cec0402018e211700d9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_450a2720664ae0c9ea72e08c39f96b41.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_63c84328f4bb5c17a9158680076418a3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_52f04335df97424042329c5ff228c8c9.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb23a50>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_c9ec14c20457c2c58ed13cf8d1f11a56.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_c9ec14c20457c2c58ed13cf8d1f11a56.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda4990>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_8a1cdd89cb799b27366af281408da02b.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_8a1cdd89cb799b27366af281408da02b.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b17af10>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_31f092d1708cbf056dcb3b0248c92c71.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_31f092d1708cbf056dcb3b0248c92c71.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_12e36bf8a891350ca43d1b1d5271354e.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda4990>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_af356e4842f51cec0402018e211700d9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_af356e4842f51cec0402018e211700d9.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bda4990>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_450a2720664ae0c9ea72e08c39f96b41.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_450a2720664ae0c9ea72e08c39f96b41.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4be6b610>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_63c84328f4bb5c17a9158680076418a3.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_63c84328f4bb5c17a9158680076418a3.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb92390>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_52f04335df97424042329c5ff228c8c9.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_52f04335df97424042329c5ff228c8c9.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_0675eba44a7336206f1a96f38a665371.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_79f6d7963c0925903beee33434999f2c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_d5aa5cf8f617c1261653d28a196c39c8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_e3f4f464c8827ef63df2e0c330430187.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0079d0>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_12e36bf8a891350ca43d1b1d5271354e.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_12e36bf8a891350ca43d1b1d5271354e.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_3503013644ab7cf6543813a691e7eb87.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_4472458c64d5d18620bb794e48a0b607.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_ee74a3b7874a000a8381a73f5fac93f4.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_a04ccb53429da876803fe3b8685c4e9c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_d3e7b5bba0071cc70d77db45e95512be.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_03d970be6462f28f0c044d397c555a00.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bd4a950>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_0675eba44a7336206f1a96f38a665371.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_0675eba44a7336206f1a96f38a665371.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_9967af3edec9657f665ead5ecb74db6a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_dc6ea07e55a027880c31ccb587612214.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_3a81efd0211e924f231c252f6b36dbd0.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b285990>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_79f6d7963c0925903beee33434999f2c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_79f6d7963c0925903beee33434999f2c.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbdaf10>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_d5aa5cf8f617c1261653d28a196c39c8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_d5aa5cf8f617c1261653d28a196c39c8.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc15b90>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_e3f4f464c8827ef63df2e0c330430187.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_e3f4f464c8827ef63df2e0c330430187.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_02a603796b563a15d1567fb61958504a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_69a526451ebdb82c936e32884dbeddc3.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0579d0>
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3e%252F39%252F3e396cc96af8af01d4c989cb442ba436%252Fpa%252FLH85097_3503013644ab7cf6543813a691e7eb87.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_3503013644ab7cf6543813a691e7eb87.jpg saved to cache
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d24f0af8-a244-5ea5-b6ac-830616b12c25
2026-03-28 18:43:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d24f0af8-a244-5ea5-b6ac-830616b12c25, skipping ID generation
2026-03-28 18:43:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d24f0af8-a244-5ea5-b6ac-830616b12c25 with scrape type 1
2026-03-28 18:43:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d24f0af8-a244-5ea5-b6ac-830616b12c25 sending to next pipeline
2026-03-28 18:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d24f0af8-a244-5ea5-b6ac-830616b12c25, identifier: LH85097
2026-03-28 18:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2856d0>
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_4472458c64d5d18620bb794e48a0b607.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_4472458c64d5d18620bb794e48a0b607.jpg saved to cache
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2163d0>
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4b%252F47%252F4b47f9750ae5dd9bdaa869e7cfab8bdc%252Fpa%252FDZ10370_ee74a3b7874a000a8381a73f5fac93f4.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_ee74a3b7874a000a8381a73f5fac93f4.jpg saved to cache
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37e7a81e-885a-58ca-b008-40a84d9e4b32
2026-03-28 18:43:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37e7a81e-885a-58ca-b008-40a84d9e4b32, skipping ID generation
2026-03-28 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37e7a81e-885a-58ca-b008-40a84d9e4b32 with scrape type 1
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37e7a81e-885a-58ca-b008-40a84d9e4b32 sending to next pipeline
2026-03-28 18:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 37e7a81e-885a-58ca-b008-40a84d9e4b32, identifier: DZ10370
2026-03-28 18:43:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb64990>
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg77%252F51%252F7751cdeb9af8536de13736dde5944089%252Fpa%252FVF76211_a04ccb53429da876803fe3b8685c4e9c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_a04ccb53429da876803fe3b8685c4e9c.jpg saved to cache
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d
2026-03-28 18:43:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5fffb58-66ff-5e60-8e46-6ff376aeea6d, skipping ID generation
2026-03-28 18:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d with scrape type 1
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5fffb58-66ff-5e60-8e46-6ff376aeea6d sending to next pipeline
2026-03-28 18:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5fffb58-66ff-5e60-8e46-6ff376aeea6d, identifier: VF76211
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0b1d50>
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_d3e7b5bba0071cc70d77db45e95512be.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_d3e7b5bba0071cc70d77db45e95512be.jpg saved to cache
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc33bd0>
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_6.jpg HTTP/1.1" 201 0
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_03d970be6462f28f0c044d397c555a00.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_03d970be6462f28f0c044d397c555a00.jpg saved to cache
2026-03-28 18:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc97490>
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_9967af3edec9657f665ead5ecb74db6a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_9967af3edec9657f665ead5ecb74db6a.jpg saved to cache
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0750d0>
2026-03-28 18:43:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_dc6ea07e55a027880c31ccb587612214.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_dc6ea07e55a027880c31ccb587612214.jpg saved to cache
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8e32792-4605-5aab-bd58-73b082afd91c
2026-03-28 18:43:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc16c50>
2026-03-28 18:43:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_3.jpg HTTP/1.1" 201 0
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_3a81efd0211e924f231c252f6b36dbd0.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_3a81efd0211e924f231c252f6b36dbd0.jpg saved to cache
2026-03-28 18:43:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_006f49f459179af656f8baa248e76b89.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d24f0af8-a244-5ea5-b6ac-830616b12c25 with identifier: LH85097
2026-03-28 18:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d24f0af8-a244-5ea5-b6ac-830616b12c25 with identifier: LH85097
2026-03-28 18:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d24f0af8-a244-5ea5-b6ac-830616b12c25 with identifier: LH85097 to the API
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_3503013644ab7cf6543813a691e7eb87.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:06:30Z',
 'fuel_type': 'petrol',
 'id': 'd24f0af8-a244-5ea5-b6ac-830616b12c25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH85097',
 'listing': 'auction',
 'location': 'DE, Wuppertal',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 82698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_814cd1986795696304b1c5b9b0de45aa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_6416269b9852388d2e03a8c4eef73726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_213379a41bff6502c0764ef1b14440f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2240732,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_5f470f1e66bf8313db1bba459bccd471.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2352587,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_3503013644ab7cf6543813a691e7eb87.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74401,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_caf227d499e47d72a5215c5dbaf061f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2282792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_7602558bc5296962806e22028fbc2042.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78108,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_6105f4b9f57eca49dfd794376c3db4c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76960,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_47a156aa4990106001319f0cea453465.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d24f0af8-a244-5ea5-b6ac-830616b12c25/d24f0af8-a244-5ea5-b6ac-830616b12c25_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3e/39/3e396cc96af8af01d4c989cb442ba436/pa/LH85097_7fb5ea983bad4c9302cbbc7a54ecc7e1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-19',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH85097%27 HTTP/1.1" 200 None
2026-03-28 18:43:20 [auto1.de] INFO: Saving data for LH85097: {'created_time': 1774723400.461867, 'last_price_update_time': 1774723400.461878, 'auction_closing_time': 1774883190.0}
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH85097') HTTP/1.1" 204 0
2026-03-28 18:43:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 37e7a81e-885a-58ca-b008-40a84d9e4b32 with identifier: DZ10370
2026-03-28 18:43:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 37e7a81e-885a-58ca-b008-40a84d9e4b32 with identifier: DZ10370
2026-03-28 18:43:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 37e7a81e-885a-58ca-b008-40a84d9e4b32 with identifier: DZ10370 to the API
2026-03-28 18:43:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_ee74a3b7874a000a8381a73f5fac93f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:22:37Z',
 'fuel_type': 'petrol',
 'id': '37e7a81e-885a-58ca-b008-40a84d9e4b32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ10370',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 47974,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_63c84328f4bb5c17a9158680076418a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1ac91d0235d7b789c00d5bb9e9622790.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1ecb82ce5b2455997f90e75164a4bae5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3090820,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_5e925a4fe546a40783aea5a5c6f2a9a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2977640,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_4472458c64d5d18620bb794e48a0b607.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2988927,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_f1c7375c3c12f41458e780c2b965acd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3047632,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_ee74a3b7874a000a8381a73f5fac93f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_6b2603a3bff39b5ace53d2cd563a2617.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2713265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_1007a7e1bee40909dec34f5955ca2c13.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e7a81e-885a-58ca-b008-40a84d9e4b32/37e7a81e-885a-58ca-b008-40a84d9e4b32_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4b/47/4b47f9750ae5dd9bdaa869e7cfab8bdc/pa/DZ10370_31f092d1708cbf056dcb3b0248c92c71.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-04-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Satellite',
 'transmission': 'manual',
 'trim': 'Satellite',
 'year': 2012}
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ10370%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [auto1.de] INFO: Saving data for DZ10370: {'created_time': 1774723401.379199, 'last_price_update_time': 1774723401.37921, 'auction_closing_time': 1774884157.0}
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ10370') HTTP/1.1" 204 0
2026-03-28 18:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5fffb58-66ff-5e60-8e46-6ff376aeea6d with identifier: VF76211
2026-03-28 18:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5fffb58-66ff-5e60-8e46-6ff376aeea6d with identifier: VF76211
2026-03-28 18:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5fffb58-66ff-5e60-8e46-6ff376aeea6d with identifier: VF76211 to the API
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_a04ccb53429da876803fe3b8685c4e9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 146,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:31:29Z',
 'fuel_type': 'petrol',
 'id': 'f5fffb58-66ff-5e60-8e46-6ff376aeea6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF76211',
 'listing': 'auction',
 'location': 'DE, Mülheim\xad-Kärlich',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 102939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 372497,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_b1ae3af46ce90c2aca6f956375b59776.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67601,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_12e36bf8a891350ca43d1b1d5271354e.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64566,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_1f4fb71ae00c6e0714234a2a29844b9d.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46352,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_450a2720664ae0c9ea72e08c39f96b41.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54225,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_33280478285649c7ae9bb57c21c3c423.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63716,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_8a1cdd89cb799b27366af281408da02b.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51695,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_c9ec14c20457c2c58ed13cf8d1f11a56.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2965816,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_a04ccb53429da876803fe3b8685c4e9c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65070,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_b86461fb5464a5c107370a43b0bf90dc.jpg',
             'Width': 640},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5fffb58-66ff-5e60-8e46-6ff376aeea6d/f5fffb58-66ff-5e60-8e46-6ff376aeea6d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47367,
             'Height': 480,
             'OriginUrl': 'https://img-pa.auto1.com/img77/51/7751cdeb9af8536de13736dde5944089/pa/VF76211_668470d234c23376e5aaa84e2d33f29a.jpg',
             'Width': 640}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': "Kia cee'd 1.4 TGDI Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2019}
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF76211%27 HTTP/1.1" 200 None
2026-03-28 18:43:21 [auto1.de] INFO: Saving data for VF76211: {'created_time': 1774723401.821825, 'last_price_update_time': 1774723401.821836, 'auction_closing_time': 1774884689.0}
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF76211') HTTP/1.1" 204 0
2026-03-28 18:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_6dc8550ae9cfb275bf3de7356936c2d8.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bbab1d0>
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_02a603796b563a15d1567fb61958504a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_02a603796b563a15d1567fb61958504a.jpg saved to cache
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b111dd0>
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_69a526451ebdb82c936e32884dbeddc3.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_69a526451ebdb82c936e32884dbeddc3.jpg saved to cache
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b1ca3d0>
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F54%252Fa35401301f6caf0583a666931aa97308%252Fpa%252FZB32219_006f49f459179af656f8baa248e76b89.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_006f49f459179af656f8baa248e76b89.jpg saved to cache
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b
2026-03-28 18:43:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b, skipping ID generation
2026-03-28 18:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with scrape type 1
2026-03-28 18:43:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b sending to next pipeline
2026-03-28 18:43:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b, identifier: ZB32219
2026-03-28 18:43:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with identifier: ZB32219
2026-03-28 18:43:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with identifier: ZB32219
2026-03-28 18:43:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c7bf403-3dad-56ce-9a2f-a08a5e4a308b with identifier: ZB32219 to the API
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_006f49f459179af656f8baa248e76b89.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:44:51Z',
 'fuel_type': 'petrol',
 'id': '0c7bf403-3dad-56ce-9a2f-a08a5e4a308b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB32219',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 71966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_f44120fc8297ae47883e511f8c777771.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_bb539196d659a2b68502e4c2b1b33be7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_d982af50cc97adc33fb18545aba0997b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73753,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_9967af3edec9657f665ead5ecb74db6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_66b539b11acd75abbdaccb4ab11704d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87634,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_7d57dc53cd2f4d72d2360ca5ec4e7700.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_819deef9e667f5c7715087b69e883a2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103377,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_006f49f459179af656f8baa248e76b89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_c538bede52b85622ef95470029b6279d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c7bf403-3dad-56ce-9a2f-a08a5e4a308b/0c7bf403-3dad-56ce-9a2f-a08a5e4a308b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/54/a35401301f6caf0583a666931aa97308/pa/ZB32219_e3f4f464c8827ef63df2e0c330430187.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB32219%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Saving data for ZB32219: {'created_time': 1774723402.847193, 'last_price_update_time': 1774723402.847204, 'auction_closing_time': 1774885491.0}
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB32219') HTTP/1.1" 204 0
2026-03-28 18:43:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_08720b985bbf112f6baac80475e08dfb.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb40790>
2026-03-28 18:43:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_6dc8550ae9cfb275bf3de7356936c2d8.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_6dc8550ae9cfb275bf3de7356936c2d8.jpg saved to cache
2026-03-28 18:43:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8e32792-4605-5aab-bd58-73b082afd91c
2026-03-28 18:43:22 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 6009 | hits on page: 40
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK48004%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for EK48004: 0
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ88731%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for WJ88731: 0
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA60872%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for WA60872: 0
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ17594%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for RJ17594: 0
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC98530%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for WC98530: 0
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET93890%27 HTTP/1.1" 200 None
2026-03-28 18:43:22 [auto1.de] INFO: Scrape type for ET93890: 0
2026-03-28 18:43:22 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01854%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for DV01854: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE23148%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for UE23148: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS91776%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for ZS91776: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX64192%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for VX64192: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED17592%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for ED17592: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX10664%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for FX10664: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85041%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for YS85041: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG54603%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for WG54603: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV82390%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for VV82390: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for SK64465: 2
2026-03-28 18:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc334e0f-49a1-5bf7-83cc-6ca9607df256 with identifier: SK64465
2026-03-28 18:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc334e0f-49a1-5bf7-83cc-6ca9607df256 with scrape type 2
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc334e0f-49a1-5bf7-83cc-6ca9607df256 with scrape type 2
2026-03-28 18:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc334e0f-49a1-5bf7-83cc-6ca9607df256, identifier: SK64465
2026-03-28 18:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc334e0f-49a1-5bf7-83cc-6ca9607df256 with identifier: SK64465
2026-03-28 18:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc334e0f-49a1-5bf7-83cc-6ca9607df256 with identifier: SK64465
2026-03-28 18:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc334e0f-49a1-5bf7-83cc-6ca9607df256 with identifier: SK64465 to the API
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:05:28Z',
 'fuel_type': 'petrol',
 'id': 'bc334e0f-49a1-5bf7-83cc-6ca9607df256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK64465',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 168515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-26',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK64465%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Saving data for SK64465: {'auction_closing_time': 1774883128.0, 'created_time': 1773945754.773166, 'last_price_update_time': 1774723403.639103}
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SK64465') HTTP/1.1" 204 0
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_dcd6aeb14adf68b39c42711d6902cbdd.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_8d721f82afdd9c3bc768d6db227c9b50.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_02b82adea75ddd5d9d45f28903d01b0c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_ddfb2daa9d43c89fd420f4a26d19c85c.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY99851%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for GY99851: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG73349%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for KG73349: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ82496%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for ZZ82496: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81744%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for MA81744: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG50767%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for KG50767: 0
2026-03-28 18:43:23 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR70360%27 HTTP/1.1" 200 None
2026-03-28 18:43:23 [auto1.de] INFO: Scrape type for AR70360: 0
2026-03-28 18:43:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b10b3d0>
2026-03-28 18:43:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F5f%252F195ff6ffc13367b8ec715e18cf979d49%252Fpa%252FZM06899_08720b985bbf112f6baac80475e08dfb.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_08720b985bbf112f6baac80475e08dfb.jpg saved to cache
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b423cfae-7005-5f07-b731-6e9c53046033
2026-03-28 18:43:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b423cfae-7005-5f07-b731-6e9c53046033, skipping ID generation
2026-03-28 18:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b423cfae-7005-5f07-b731-6e9c53046033 with scrape type 1
2026-03-28 18:43:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b423cfae-7005-5f07-b731-6e9c53046033 sending to next pipeline
2026-03-28 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b423cfae-7005-5f07-b731-6e9c53046033, identifier: ZM06899
2026-03-28 18:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b423cfae-7005-5f07-b731-6e9c53046033 with identifier: ZM06899
2026-03-28 18:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b423cfae-7005-5f07-b731-6e9c53046033 with identifier: ZM06899
2026-03-28 18:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b423cfae-7005-5f07-b731-6e9c53046033 with identifier: ZM06899 to the API
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_08720b985bbf112f6baac80475e08dfb.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 411,
 'expiration_date': '2026-03-30T15:00:07Z',
 'fuel_type': 'petrol',
 'id': 'b423cfae-7005-5f07-b731-6e9c53046033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM06899',
 'listing': 'auction',
 'location': 'DE, Karlsruhe',
 'make': 'BMW',
 'model': '2er',
 'odometer': 56824,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2429559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_08720b985bbf112f6baac80475e08dfb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_0675eba44a7336206f1a96f38a665371.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_b5887857fc53aa07cb29184ad207c7e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_d4264ddce79a84bc82557df6fd735ad6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_af356e4842f51cec0402018e211700d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_52f04335df97424042329c5ff228c8c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_15e1bba84e54b2afb7ae67e123b7b82d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_e0f50bb00b22bfc06907f7ea2df206c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63253,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_2747eb6b543eea6217562a3475538aa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b423cfae-7005-5f07-b731-6e9c53046033/b423cfae-7005-5f07-b731-6e9c53046033_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/5f/195ff6ffc13367b8ec715e18cf979d49/pa/ZM06899_ae6fb381ba9e52302121b676110089b0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 2er M2 Competition',
 'transmission': 'automatic',
 'trim': 'Competition',
 'year': 2019}
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM06899%27 HTTP/1.1" 200 None
2026-03-28 18:43:24 [auto1.de] INFO: Saving data for ZM06899: {'created_time': 1774723404.473181, 'last_price_update_time': 1774723404.473192, 'auction_closing_time': 1774882807.0}
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM06899') HTTP/1.1" 204 0
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b16e2d0>
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_dcd6aeb14adf68b39c42711d6902cbdd.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_dcd6aeb14adf68b39c42711d6902cbdd.jpg saved to cache
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a6350>
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgaf%252F9a%252Faf9af6629d771ed07b5e8f709d7d0f51%252Fpa%252FPN96283_8d721f82afdd9c3bc768d6db227c9b50.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_8d721f82afdd9c3bc768d6db227c9b50.jpg saved to cache
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b
2026-03-28 18:43:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b, skipping ID generation
2026-03-28 18:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with scrape type 1
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b sending to next pipeline
2026-03-28 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b, identifier: PN96283
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bb3d190>
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc5%252F68%252Fc5681e362f4ee54a28e952b441b5ec0b%252Fpa%252FYC95910_02b82adea75ddd5d9d45f28903d01b0c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_02b82adea75ddd5d9d45f28903d01b0c.jpg saved to cache
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8e32792-4605-5aab-bd58-73b082afd91c
2026-03-28 18:43:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8e32792-4605-5aab-bd58-73b082afd91c, skipping ID generation
2026-03-28 18:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8e32792-4605-5aab-bd58-73b082afd91c with scrape type 1
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8e32792-4605-5aab-bd58-73b082afd91c sending to next pipeline
2026-03-28 18:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8e32792-4605-5aab-bd58-73b082afd91c, identifier: YC95910
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2a6110>
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_1.jpg HTTP/1.1" 201 0
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_ddfb2daa9d43c89fd420f4a26d19c85c.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_ddfb2daa9d43c89fd420f4a26d19c85c.jpg saved to cache
2026-03-28 18:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with identifier: PN96283
2026-03-28 18:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with identifier: PN96283
2026-03-28 18:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b with identifier: PN96283 to the API
2026-03-28 18:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_8d721f82afdd9c3bc768d6db227c9b50.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:37:42Z',
 'fuel_type': 'hybrid',
 'id': 'ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN96283',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 11575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49675,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_4024f9bb3162f8a8f4be9826feb4220c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_3e7b483181fe95fb7f0919e1d76e0c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39946,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_5f2a7d5635ac0e9bc9f13d3d6d1a4ef9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_4cbf926fba1c74a39f893ef296d3f78e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54748,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_add594e61b5e03e91ec773a42abf344b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_ad74f7d9e8f4fd19ae3afe26fbb2bf58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_60991ba450aab4401daed8c8a4d6bace.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_ac76e9cc0cda95e56dea33b9011c6e9e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_8d721f82afdd9c3bc768d6db227c9b50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b/ce5c69d4-1fed-5b9a-897e-5b3ca5ff8a6b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaf/9a/af9af6629d771ed07b5e8f709d7d0f51/pa/PN96283_dcd6aeb14adf68b39c42711d6902cbdd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2024}
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN96283%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Saving data for PN96283: {'created_time': 1774723405.329171, 'last_price_update_time': 1774723405.329186, 'auction_closing_time': 1774885062.0}
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN96283') HTTP/1.1" 204 0
2026-03-28 18:43:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8e32792-4605-5aab-bd58-73b082afd91c with identifier: YC95910
2026-03-28 18:43:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8e32792-4605-5aab-bd58-73b082afd91c with identifier: YC95910
2026-03-28 18:43:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8e32792-4605-5aab-bd58-73b082afd91c with identifier: YC95910 to the API
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_02b82adea75ddd5d9d45f28903d01b0c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine': '1.7L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:52:04Z',
 'fuel_type': 'petrol',
 'id': 'e8e32792-4605-5aab-bd58-73b082afd91c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC95910',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Fiat',
 'model': 'Barchetta',
 'odometer': 174135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_02b82adea75ddd5d9d45f28903d01b0c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75823,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_32baca9b10e5203df9e4baf85d8096fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_6dc8550ae9cfb275bf3de7356936c2d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_dc6ea07e55a027880c31ccb587612214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8e32792-4605-5aab-bd58-73b082afd91c/e8e32792-4605-5aab-bd58-73b082afd91c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc5/68/c5681e362f4ee54a28e952b441b5ec0b/pa/YC95910_c205f9df8836f7e01b390e1566e681cd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1998-03-30',
 'seats_number': 2,
 'seller_name': None,
 'title': "Fiat Barchetta 1.8 Limited Edition '99",
 'transmission': 'manual',
 'trim': "Limited Edition '99",
 'year': 1998}
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC95910%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Saving data for YC95910: {'created_time': 1774723405.761145, 'last_price_update_time': 1774723405.761157, 'auction_closing_time': 1774885924.0}
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC95910') HTTP/1.1" 204 0
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_031cf6237dca52b9ce88ebe40d972973.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_86be8f82aa946b2d88c3495e39158095.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_4aea5d195cd2cbc6ea98e5b78722756a.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_c65158a8fcbe0c4d2f3ceede7af766ec.jpg> (referer: https://www.auto1.com/)
2026-03-28 18:43:25 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 6009 | hits on page: 9
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL74124%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Scrape type for XL74124: 0
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX78972%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Scrape type for WX78972: 0
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW02363%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Scrape type for TW02363: 0
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV43994%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Scrape type for YV43994: 0
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY99539%27 HTTP/1.1" 200 None
2026-03-28 18:43:25 [auto1.de] INFO: Scrape type for HY99539: 0
2026-03-28 18:43:25 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-28 18:43:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-03-28 18:43:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-28 18:43:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00\xd8\x00\x00\x00\x01'
2026-03-28 18:43:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-03-28 18:43:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-03-28 18:43:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b2fb350>
2026-03-28 18:43:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_0.jpg HTTP/1.1" 201 0
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgab%252F5e%252Fab5e15f13c670aed002687f760995123%252Fpa%252FMW28967_031cf6237dca52b9ce88ebe40d972973.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_031cf6237dca52b9ce88ebe40d972973.jpg saved to cache
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b2b8b493-d5d3-526c-9c44-5b4e339bd048
2026-03-28 18:43:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b2b8b493-d5d3-526c-9c44-5b4e339bd048, skipping ID generation
2026-03-28 18:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2b8b493-d5d3-526c-9c44-5b4e339bd048 with scrape type 1
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b2b8b493-d5d3-526c-9c44-5b4e339bd048 sending to next pipeline
2026-03-28 18:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2b8b493-d5d3-526c-9c44-5b4e339bd048, identifier: MW28967
2026-03-28 18:43:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bc4fc10>
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_86be8f82aa946b2d88c3495e39158095.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_86be8f82aa946b2d88c3495e39158095.jpg saved to cache
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4bdde250>
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_4aea5d195cd2cbc6ea98e5b78722756a.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_4aea5d195cd2cbc6ea98e5b78722756a.jpg saved to cache
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f3b4b0a4550>
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 18:43:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Ff7%252Fecf718bc14c8bd1d800ff3c26f7bbc3d%252Fpa%252FCE21106_c65158a8fcbe0c4d2f3ceede7af766ec.jpg') HTTP/1.1" 204 0
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_c65158a8fcbe0c4d2f3ceede7af766ec.jpg saved to cache
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3534d46-2d46-50dd-bb70-8f487d14215f
2026-03-28 18:43:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3534d46-2d46-50dd-bb70-8f487d14215f, skipping ID generation
2026-03-28 18:43:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3534d46-2d46-50dd-bb70-8f487d14215f with scrape type 1
2026-03-28 18:43:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3534d46-2d46-50dd-bb70-8f487d14215f sending to next pipeline
2026-03-28 18:43:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3534d46-2d46-50dd-bb70-8f487d14215f, identifier: CE21106
2026-03-28 18:43:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2b8b493-d5d3-526c-9c44-5b4e339bd048 with identifier: MW28967
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 18:43:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 18:43:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2b8b493-d5d3-526c-9c44-5b4e339bd048 with identifier: MW28967
2026-03-28 18:43:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2b8b493-d5d3-526c-9c44-5b4e339bd048 with identifier: MW28967 to the API
2026-03-28 18:43:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_031cf6237dca52b9ce88ebe40d972973.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:34:16Z',
 'fuel_type': 'electro',
 'id': 'b2b8b493-d5d3-526c-9c44-5b4e339bd048',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW28967',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Cupra',
 'model': 'Born',
 'odometer': 49377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1647010,
             'Height': 968,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_031cf6237dca52b9ce88ebe40d972973.jpg',
             'Width': 1290},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_ddfb2daa9d43c89fd420f4a26d19c85c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112475,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_69a526451ebdb82c936e32884dbeddc3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_3a81efd0211e924f231c252f6b36dbd0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_02a603796b563a15d1567fb61958504a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113942,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_57053635fa11ab8e6a3e444caa719331.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_03d970be6462f28f0c044d397c555a00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_d3e7b5bba0071cc70d77db45e95512be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97607,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_d5aa5cf8f617c1261653d28a196c39c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b2b8b493-d5d3-526c-9c44-5b4e339bd048/b2b8b493-d5d3-526c-9c44-5b4e339bd048_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83371,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgab/5e/ab5e15f13c670aed002687f760995123/pa/MW28967_79f6d7963c0925903beee33434999f2c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Cupra Born electric drive 150 kW',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW28967%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [auto1.de] INFO: Saving data for MW28967: {'created_time': 1774723407.132639, 'last_price_update_time': 1774723407.132652, 'auction_closing_time': 1774884856.0}
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW28967') HTTP/1.1" 204 0
2026-03-28 18:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3534d46-2d46-50dd-bb70-8f487d14215f with identifier: CE21106
2026-03-28 18:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3534d46-2d46-50dd-bb70-8f487d14215f with identifier: CE21106
2026-03-28 18:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3534d46-2d46-50dd-bb70-8f487d14215f with identifier: CE21106 to the API
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 18:43:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_c65158a8fcbe0c4d2f3ceede7af766ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:10:29Z',
 'fuel_type': 'diesel',
 'id': 'e3534d46-2d46-50dd-bb70-8f487d14215f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE21106',
 'listing': 'auction',
 'location': 'DE, Schwerin',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 170905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2980354,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_e5c6fc85353bde7e700938f7663d5cd5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83165,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_57e5da13f37695b2dcf2dc8a4168eed4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2807892,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_51d1151d1b1d35f8a6a8cf670e70b375.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2820792,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_8c82402cf0d6511ef8afe64edc2aa7f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2874418,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_c65158a8fcbe0c4d2f3ceede7af766ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3002313,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_4aea5d195cd2cbc6ea98e5b78722756a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3055834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_67d5d30dc29c818b6aa0936b12ec15c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3018393,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_86be8f82aa946b2d88c3495e39158095.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_a214f6c9c7277479592599c42c6258fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e3534d46-2d46-50dd-bb70-8f487d14215f/e3534d46-2d46-50dd-bb70-8f487d14215f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/f7/ecf718bc14c8bd1d800ff3c26f7bbc3d/pa/CE21106_e6a373d56be463f282ed63e630670f5e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-12',
 'seats_number': 1,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 Blue-HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2017}
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE21106%27 HTTP/1.1" 200 None
2026-03-28 18:43:27 [auto1.de] INFO: Saving data for CE21106: {'created_time': 1774723407.606451, 'last_price_update_time': 1774723407.606462, 'auction_closing_time': 1774883429.0}
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE21106') HTTP/1.1" 204 0
2026-03-28 18:43:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 18:43:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 18:43:31 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 6009 | hits on page: 0
2026-03-28 18:43:31 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 18:43:31 [auto1.de] INFO: auto1.de Batch config: batch 1/2
2026-03-28 18:43:31 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20last_price_update_time%20lt%201774291411 HTTP/1.1" 200 None
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AA20994') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AE90163') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AH66098') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AK98445') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AN56008') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AN96005') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AP79794') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AR26654') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AS73684') HTTP/1.1" 204 0
2026-03-28 18:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AW92871') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AX33260') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='AX57511') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BC24686') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BC77131') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BF97911') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BG61278') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ21162') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ60508') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BL84169') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BN25354') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS51410') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BS88895') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BV45270') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX35441') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BX77660') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ59739') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CB77514') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CD01528') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE50522') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CE90661') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF63525') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CF66717') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CR78512') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CS20685') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CV93428') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CW62818') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='CX69892') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DC20194') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DG85358') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DK74361') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DR00111') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DS17999') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DT65501') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='DY73068') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EB47444') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ED16216') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EH55820') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ54340') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EK40849') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EL52621') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EM38496') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EU85919') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='EW99675') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FB76494') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FD34502') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FD65822') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ31888') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FM35774') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FN23849') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FP73582') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FR03758') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FS10323') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT19707') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FT73335') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FW15176') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FX09230') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='FY73058') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GH30398') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GM43838') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GP05483') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GP56337') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GW43406') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GX36194') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY35328') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='GY49196') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA57688') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HA59022') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HC02737') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HF23324') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HM32781') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT71943') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HT93324') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HU87320') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HW29641') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX88437') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='HX93212') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JD19964') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JG30738') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JW38417') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JY94819') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ71299') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KA99574') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KB77870') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KC86005') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KF13155') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KG82874') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KP40994') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KP59339') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KS32640') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KT46853') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KU40720') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KX58992') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KY17938') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ19653') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LF81313') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LG84853') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LK02148') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LL27807') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LL73121') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LM47126') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LP00059') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LR07938') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LU44895') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='LY26673') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MB02757') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MF48668') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MG13912') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MN41860') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MN72328') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MN78455') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MR05177') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MV76733') HTTP/1.1" 204 0
2026-03-28 18:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MW04330') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MX79437') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MY89938') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ46068') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ75560') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NA09387') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NB48457') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NB61940') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NC49807') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NH17997') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NP08789') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NP21892') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NR24854') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NS63245') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NU00265') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='NV60113') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PA99817') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PC52157') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH17344') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PH21162') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PK60934') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PL56011') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PM63573') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PP52086') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ16247') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RA69083') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RB08989') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RC05413') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RD19227') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RK72597') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RN48181') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RP83469') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RY08966') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ32125') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SB86751') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SG74460') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SH33487') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SK66024') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SL00980') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SP98242') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SR81366') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ST00761') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SU15122') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SU63626') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SW36019') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SX90509') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='SY91111') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TB12962') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TE40577') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TE49363') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TE66497') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TF05985') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TG43907') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TK23514') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TR93945') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TV34196') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TX35050') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='TY58798') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UA27050') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UA81183') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UD25726') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE20291') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UE61006') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UR10750') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ89172') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VD44929') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VE62088') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VG09057') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH46777') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VH53877') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ13940') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ82388') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VR64138') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VS57009') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VV15875') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VX94939') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VY63295') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ50798') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ63772') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC05897') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WC82795') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WD25524') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WG94407') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ41150') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WX06998') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ98174') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XC40534') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XE05713') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL07735') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XL66615') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XP67943') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XS34646') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ37460') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YA76210') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YA83690') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YB44164') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YE22620') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YL33228') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YR09566') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YR41520') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='YS72971') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA20787') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA98694') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZC32794') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE02762') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF92310') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG29062') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG43820') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG83650') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH09759') HTTP/1.1" 204 0
2026-03-28 18:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK56967') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL56740') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM55157') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM69144') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM89162') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN12985') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP18226') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV17284') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ21585') HTTP/1.1" 204 0
2026-03-28 18:43:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.de',RowKey='ZZ54127') HTTP/1.1" 204 0
2026-03-28 18:43:34 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (788 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_17_2026-03-28T18_30_00.jl
2026-03-28 18:43:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 3363426,
 'downloader/request_count': 1930,
 'downloader/request_method_count/GET': 1776,
 'downloader/request_method_count/POST': 154,
 'downloader/response_bytes': 975894896,
 'downloader/response_count': 1930,
 'downloader/response_status_count/200': 1930,
 'dupefilter/filtered': 5,
 'elapsed_time_seconds': 806.983101,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 18, 43, 34, 80764, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 788,
 'log_count/DEBUG': 24081,
 'log_count/INFO': 25775,
 'memusage/max': 202952704,
 'memusage/startup': 147861504,
 'photo_download_count': 1314,
 'request_depth_max': 155,
 'response_received_count': 616,
 'scheduler/dequeued': 1930,
 'scheduler/dequeued/memory': 1930,
 'scheduler/enqueued': 1930,
 'scheduler/enqueued/memory': 1930,
 'scrape_type/batch_skipped': 3032,
 'scrape_type/new': 230,
 'scrape_type/price_update': 558,
 'scrape_type/skipped': 2224,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 616,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.2873562705527677,
 'scrapy-zyte-api/mean_response_seconds': 3.3235130980731813,
 'scrapy-zyte-api/processed': 616,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 616,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 615,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 616,
 'scrapy-zyte-api/request_args/httpRequestBody': 154,
 'scrapy-zyte-api/request_args/httpRequestMethod': 154,
 'scrapy-zyte-api/request_args/httpResponseBody': 616,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 616,
 'scrapy-zyte-api/request_args/sessionContext': 616,
 'scrapy-zyte-api/request_args/url': 616,
 'scrapy-zyte-api/status_codes/200': 616,
 'scrapy-zyte-api/success': 616,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 6049,
 'source/total_available': 6009,
 'start_time': datetime.datetime(2026, 3, 28, 18, 30, 7, 97663, tzinfo=datetime.timezone.utc)}
2026-03-28 18:43:34 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 18:43:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f3b59d299d0>
2026-03-28 18:43:34 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f3b59e53f50>